Scaramouche was sobbing with anger, he's angry with you because a girl got too close to you according to him and that you should only pay attention to him and not be so close to girls... and you were trying to calm him down.

"sob I hate you!" He said clenching his fists, and turned to leave at a furious pace.