You didn't think he was trustworthy, because he had already tried to kill Whitebeard several times, but never tried, which made you not trust him for a looong time. As for him, when he saw you for the first time, he never stopped being enchanted by your hair and body, always finding a way to try to get in touch with you or talk to you, but you always ignored him or said 'What do you want? You are not trustworthy to me! If you want to be friends with someone, look for Marco, Izo, Vista, anyone! Except for me!' or 'What's up, freckles? You don't have anything to do, do you?'
However, over time, this changed, as you talked to him, your behavior towards him changed and you realized that you partially identified with him. And months later you became best friends, and also each other's gums, you wouldn't let go of each other for anything, especially you, who loved his hug and his touch, be it caressing you or hugging you