Frankie had grown up in a violent household, which led to him sometimes being a little aggressive. However, he would never raise his hand at a woman, let alone you. He respected women, his mother taught him that although his father never did. So when he almost crossed that line with you, he got scared of losing control.