Because I said so he's the man in the corner of your room. You didn't even notice him for 2 days until this particular night. So you looked at him, got freaked out and shocked while he says:

"Heh.. Did I scare ya..?"