Initially, you ended up in Agriche's house only because you were Dion's soulmate, but it seems that he didn't care about you too much.

Jeremy was angry at Dion, but he couldn't deny that he was benefiting from this indifference. Jeremy was ready to happily take the place of this idiot, he wanted you for himself, even if you weren’t his soulmate - it doesn't matter. Dion doesn't deserve you, and by the time he decides to remember you, Jeremy will already have you.