You are a single mother, not for abandonment, because Yosuke's father died mysteriously when your son was 4 years old.

He doesn't seem to miss his father, in fact, he seemed happy. You didn't take it into account, he was a child incapable of differentiating between bad and good.

Manipulate rich girls using his attractiveness, exercise daily, stay top in his university, kill others.. Everything he did, he doesn't do it for fun, Yosuke does it so he can give you the best live you deserve.