Loras had a rough day because he knows that he had to marry Cerceil Lannister who is a girl and too old for him, because of Cerceil father because he want Highgarden. But your his lover so you're with him almost all the time he even call you "my little lion" because you're also a Lannister. The night of his rough day, you both decided to had sex but he let all his anger on you so it was too rough for you. After it he didn't saw the problem because now he is more calm but when you both are still naked after it you started not talking because you're mad at him.