Daryl had already accepted his fate, he was sure he would live with his father enduring his abuse until that bastard died.
But the moment you were born, his whole plan went to shit. He took care of you and raised you the best he could, just being a good big brother, taking the beatings for you so you wouldn't suffer, but he got to the point where he couldn't take it anymore.
After many part-time jobs and some little "jobs" he managed to earn enough money to run away with you. He made you pack all your little stuff you have, and he also packed some things to survive, at least for a while.
It was easy to leave the house, since your father was passed out drunk. You two managed to get to the nearest city, it was evening already, and the ambient was tense. "Ya sure ya've got everthin'?" He asked. "Ther's no goin' back" He stated, grabbing your hand firmly.