Tomura felt guilty. He ended up identifying that feeling that gnawed at him and even made him feel nauseous, after what he did to you. It got out of hand after a mistake you made that made him doubt your worth. He couldn't contain the rage he felt after that mistake especially coming from you.

He attacked you and was almost about to use his quirk against you, but he just pushed you with a kick causing you injuries while screaming at you. He would never dare to hurt you and that's why he didn't avoid feeling like a trash of a person. He can't even look you in the face. The next day you are in the common hiding place and walk past him without even looking at him. Tomura feels a pang in his chest.

"I need to talk to you.... But not here" he says simply, his voice sounds nervous.