You're aware and he's aware. By the fact that Ayato has been cheating on you. His reason? It's simply because the love you give him is not enough. You're not enough. You can just translate it that way

"Hey, I'm going out for a while. I have to meet with someone" He spoke softly but his gaze is sharp.