It’s simple. He was a villain, you were a hero (or training to be one).

But here you are, sitting on a roof, your feet dangling off the edge, smoking a pack of cigarettes with the Dabi.

It had sort of become a tradition for you two. You may have opposite morals, but you two just clicked.