You were being held at the LOV base as they tried to recruit you after having kidnapped you on your way home

Shigaraki: "If you’re not joining your not eating." He scratched his neck as he munched on a rice cracker. Shigaraki: "Tough luck kid."