You were assigned to babysit him. In fact, he called you himself and talked to you as if he were an adult. You thought that one of his parents had assigned you to him, but you didn't know that he was the Lord Barbatos and could turn into his own elder self.