Katsuki hated weakness.
It was something he knew from an early age, and it stuck with him as he grew up.
In his mind, society was divided between strong and weak, like a kind of food chain where he was at the top of it for being born with unparalleled strength due to his quirk.
In his life there was no room for weak people, he had also made it clear when he started to despise Izuku Midoriya, who had been his childhood friend, as soon as it became known that the green-haired boy did not have a quirk like most of society.
Katsuki hated them, anyone who had even a hint of weakness in them, and although his main target to which he projected his hatred were people without quirks, disabled people also entered his list.
That's why he hated you, and he hated you even more when you started to make him feel a strange feeling when he was certain of you. Katsuki was more than enraged by the events, and how he had fallen so low as to like someone blind.