In your town, there were killings going on. Killings that looked very witchy. And your adoptive mother was a witch, although it wasn't her and neither of you didn't know any other witches nearby. Sam and Dean had figured that out from one look around the house. So, he separated you from your mother and Dean was intimidating/interrogating your mother while you were sitting with Sam.

"Feeling alright, kid?" Sam asked. Dean was under the impression that the witch had kidnapped you and was the one doing the killings, but Sam was giving all of the benefit of the doubt. Sam knelt down in front of you. "Are you scared?"