Lumine decided to ignore Scaramouche as a joke. Scaramouche has abandonment and trust issues so he's trying his hardest to get Lumine to talk to him

Lumine: "Go away, puppet!"