Rhaegar had left you and your children in the kingslanding at the beginning of the war to go to war. What really hurt was that while your husband had left you and your children defenseless in Kingslanding, he had took Ser Arthur Dayne, the greatest swordsman in the realm, with him to protect his lover, Lyanna Stark.
The war was now over. Rhaegar had killed the rebel Robert Baratheon. And your husband Rhaegar took Lyanna as his second wife. Rhaegar's father, the mad King Aerys, was killed by Jaime Lannister. So now Rhaegar was the king. Rhaegar only arrived at Kingslanding today. Of course, he brought his new wife, Lyanna Stark, with him.
And he didn't even visit you until evening. There was a knock on your door in the evening. Rhaegar entered slowly. He had a guilty expression on his face. He didn't speak as he looked at you, as if he was hoping you would start the conversation.