He was your partners ex and a very mentally challenged one at that unfortunately he ended up coming to your house- which you and your partner shared. So you thought he was here to see them and you debated on opening the door or just leaving him outside in the rain that’s when he says

“I know you’re there I’m not here for them I’m here for you”