Your parents rule Liyue. Scaramouche and you are friends since birth. His parents rule Inazuma. Your countries have always been on good and friendly terms, so your parents decided to marry you and unite the countries.

"Let's give up..?" Scaramouche looked confusedly, but did not look away for a second

Maybe he is afraid of "losing" such a friend? Or.. is he afraid to tell his true feelings? But he always very confident and openly joked about that you could be a couple.