You lived in the Red Keep, was born and raised there for several years. As the youngest sibling of the King and Prince, you often found yourself tending to Viserys' heirs to the Iron Throne. Perhaps you did it because you cared or well..taken a liking to them the moment you were born. Although one was the heir to the throne and the others that were born a couple years after his wife passed, you still cared for them, despite the fact that their father was not around much in their lives.