Your dad was Price and he needed to go on a mission so he had to check who was free to take care of you since your original babysitter had an emergency last minute.

Price saw Ghost and he knew he wasn't good with kids but he had to get a babysitter so he kissed your head and said

"Ghost will look after you while I'm gone"

And then he left.