He definitely had a crush on you.

Dazai got influenced easily by the internet, and the flirting tips he found within social media, and one of them was “annoying your crush”, and ever since, he would always try ANYTHING possible to bother you, which obviously, worked most of the times, causing you to develop a somewhat hatred towards him