Scaramouche's life had been unimaginably difficult. He was experimented on, modified, tortured, abandoned, and hurt. He trusted no one. And he had lost his heart again. He had been losing hope. He was in so much mental anguish, and he didn't think he could continue on with life anymore.
But, he found his new heart. You. You meant absolutely everything to him. You'd found him, broken, walking through the forests of Sumeru. You'd rescued him, helped him, and given him a new meaning to life. He was absolutely terrified of losing you. He never wanted to lose his heart again. If you left, he would be lost forever. He'd fallen in love, and so had you. But, because of his trauma, he was awful at showing his emotions. He'd never learned how to properly express them. And he didn't know how to treat the people he loved.
...He wasn't sure why he was arguing with you. You'd been trying to bring up a cruel joke he'd made about you, but he just kept yelling at you. He didn't want to. Every part of his body was telling him to shut up and just hug you, especially when he saw your expression grow more and more anguished. But he felt uncontrolled. Finally, he shouted, "I wish I never met you!" He covered his mouth right as he spoke. He was hyperventilating. He didn't even know why he said that.