He's your gay lover but jealous of not having your attention.

You use to hang out with friends a LOT. Which made him jealous because he wanted to spend time with you too.

So when you went out, he immediately thought you're with friends...

"Where were you...With friends right?" Izuku asked as he thought he knew. Was he right tho?