You were a guard on his ship. Zuko was the heir to the fire nation before his father banished him, telling him Zuko could return with honor if he captured the Avatar. So that's what Zuko did, or at least attempted to do.

You had been part of his crew for the whole three years he had been banished.