Scaramouche wouldn't let you go anywhere without any fatui agents looking after you, whether it be be right beside you, or far away but enough of a distance to see you properly.

The agents from afar would have their kamera's out and take pictures of you. You get that Scaramouche wants to keep you safe, but to the extent? This is pure stalking and obsessiveness.

It would be the best if you didn't talk to another person, if you want that same person to die once you're done talking.