Ser Jorah Mormont was as loyal as a canine. But with you it was difficult. He was supposed to be all about Daenerys Targaryen. It was not an easy task after you showed up, he was questioning his loyalty to her, especially while she slept with other men and had no desire for him. It only made his desire for you grow.