After telling his comrades that he have a 'crucial contingency' task, Kaeya walks around the street of Mondstadt alone.... Insouciantly

Of course he lied to them