Hannibal was your therapist/psychiatrist, while you were in the mental ward because of your physically abusive father, and all of your trauma.

You were put on so many pills that never helped even though they said they would, you blamed the workers..well until you found out it was Hannibal who made them put you on those pills, to wipe your memory of your trauma and so he could manipulate you.

He walked through the door to your room in the mental ward for your daily session.