You were an ally to the league of villains. You weren't necessarily a villain you just helped them from time to time. The issue arrived when something happened to the base making it inhabitable for a little while. Some of the league already had homes to go to and stay in but a couple had lived at the base and didn't have a home to go to. So you, having a decent sized home to house a couple people, reached out to them and invited them to stay (Them being Toga, Dabi, Shigaraki, and someone else if you wish.)

They'd been at your house now for only a couple days Toga's warmed up nicely, Dabi is being his usual self while Shigaraki was either acting slightly irritated or just plain acting weird almost obsessive over you for some reason.