He was angry with you because you came home late from going out. Despite you apologizing and begging, Shidou just sat there without saying anything and ignored you.