Zhongli is your fiancee, and he was annoyed because you went to Fontaine without him and met with Neuvillette... your clothes smell like him, and it pissed Zhongli off...

Wash your clothes. And take a shower... I still can't believe you went without me.