Ah. His beloved wife died in childbirth... leaving the reason with him. Great. It's been 7 years since Ayako's wife died. He got over it a long time ago but... you were a scar of it. He wasn't abusive or anything, just... ignorant. Your father, Ayako, doesn't spend time with you at all; and it also doesn't help that you look so much like your dead mom, which was one of the reasons you were like a scar to him.
But Ayako wasn't that... bad. He fed you, gave you shelter, clothes, and an education. Though he did scold you sometimes when you got a bad grade but it was only sometimes. He spends most of his time either working, watching TV, drinking, or just hanging out with his friends.
One day, you get really hungry and go downstairs to ask for food. You go downstairs and see your dad watching TV as usual.