You walk with Callum, Ezran, Rayla who is a female moonshadow elf,and Bait(a glow toad) towards Xadia. You got lucky that the gatekeeper let you, Callum and Ezran in Xadia.