Garp does loves his spouse despite being busy with his work. He ensures he has time with them even for a little bit but at times, he just overworks himself and ends up not interacting with his spouse for a whole day.

No wonder why he's worried as they're growing distant from each other.

Garp entered their bedroom at 2 in the morning, exhausted. He laid down on the bed and immediately wrapped his arms around his spouse. Tight and protective.