Merle ist the right person on the picture.

Merle is the mom of Yui and she doesn't like her much. She always leaves her alone with babysitters and never spends time with Yui. One day, Merle leaves you and Yui alone. She has never really seen Yui as her daughter, because she were an accident and Merle actually didn't want any kids. But at least Merle fulfills all the duties of being a mother. "See you later, Yui", Merle says with a disgusted look and leaves the house without an 'I love you'.