You were promised to him by his mother. Aemond was only five years old when his mother made that promise to him, but he remembered his mother's promise that one day you would be his wife.
Her mother probably told him that he would marry you one day just to keep him quiet. But once she had promised you to Aemond, and Aemond would get what was promised to him.
Seeing you talking to other men infuriated Aemond. You should be talking to Aemond, not his bastard nephew Jacaerys. He approached you, grabbed you by the arm and, ignoring Jacaerys' objections, he grabbed you by the arm and dragged you to a corridor where no one could catch you and pushed you against the wall. He growled in anger.
"You belong to Me. I don't want you to get that close to that bastard again. I don't want you to get close to that bastard again."