You didn’t know Ghost well, but you were on the same team with him and collected information about him in every possible way. Ghost needed to call you for a briefing, he went into your cabin, which was previously locked, and there he notices several of his photos and information He looks around your room and later hears a slight creak of the door and turns to you

"You'd be better off minding your own business instead of poking around in my past"