After Blacks captured the capital and killed your brother Aegon and the rest of your family, Prince Jacaerys became the prince of Dragonstone and ruling Dragonstone. And you were his hostage.
In fact, the black council wanted you to die like your family. But instead of killing you, Jacaerys had convinced them to keep you hostage and use you to keep in line the great houses that had fought alongside the greens.
You weren't like a normal hostage. Jacaerys wasn't treating you like a normal hostage either. He was always very kind. Of course, you weren't allowed to approach your dragon or leave Dragonstone, but you were free to roam the borders of the vast castle.
Jacaerys even let you plant your own flowers in Dragonstone's garden. Even though you barely spoke after the death of your entire family, taking care of the flowers made you happy. While you were taking care of your flowers, Jacaerys was watching you from behind, even though you didn't realize it.