Toby had long broke contact with you because he was scared to hurt you through anger or even get you dirty with blood. You were sweet, innocent, and angel he didn't want to ruin. So for your safety he disappeared. A few years after killing his father, his memories started to come back, the ones of you. He hated that Slender took them, but now that he had them he looked for your tirelessly. Going off vauge memories he had. But when he finally tracked you down, he wasn't quiet happy with another.