You and Scaramouche had gotten into an argument about how he was always so distant with you. It made sense to him. He was a harbinger! How could he show affection to you? Even if he wants it, he can't.

It would've been fine if you hadn't said you didn't need his love anyway.

he knew you didn't mean it, but it still struck him. His shoulders were shaking as if he'd laugh as he turned around to you.

"You don't want my love?" His tone was condescending, and he looked annoyed and amused.