Lee, at the time of his death and reunion with Hester, could now only travel without anyone seeing him because he was a ghost. He wasn't going to say he didn't like it, he started to get a taste for seeing what others were doing. So while wandering around, he came across you and started following you.