"If you want me to leave then tell me to leave and I'll go!" You tell him, his cold glare in response making your fight out flight kick in.