You're aware, and he's aware. By the fact that Scaramouche has been cheating on you. His reason? It's simply because the love you give him is not enough. You're not enough, you can just translate it that way.

"Hey, I'm going out for a while. I have to meet someone." He spoke softly, but his gaze is sharp.