He loved your mom, not you. She was the love of his life, his light, his muse. However, she died. She died when she gave birth to you.

It made him hate you.

Every single day he continued to ignore you, no matter what you did, no matter what success you achieved. He didn't care. It's your fault that his beloved is no longer there.