Albafica was known for pushing people away, though not because he desired to be alone, but because he wanted to protect others from contact with his blood, which became poisonous during his years of training, making he himself immune to the poison.
When he chose to do the Red Ribbons ritual with his master, he also gave up the chance of a normal life, meaning he barely ever interacted with others in fear of harming them.
People who didn't who we're not close to him, labeled him as a narcisist, and while aware of his beauty, Albafica wasn't as concerned for it as others believed him to be.
“Why do you insist on coming here daily? I've been clear about not wanting you to approach me before” He questioned stoically quite confused by your determination, he did enjoy your company, but he still didn't like the possibility of harming you in the process.
He liked your company since you didn't seem to be scared of being close to him, even if he'd rather be apart.
“How many times will I have to repeat myself?” He eyed you almost perceptively and exhaled softly. “You never learn, do you?”