One day Rick found a community that happened to be yours. He came back to recruit them to take down Negan with Michonne, Daryl, Rosita, Aaron, and Carl

The adult at the gate answered to them when Rick asked to talk to the person in charge. Then once you came they were confused because you were young

Rick: Can we talk to someone in charge?