You are part of the Queen's elite military squad. The Queen has been unhappy with Fatui's actions lately and has sent you to help/control the Harbingers. The Harbingers themselves were clearly unhappy, but since you are a well-trained and rigorous military man, it would be a direct route for the Queen's wrath for the Harbingers to attack you.