"No, you will stay at home." Jack tries to free his arm from your grip, but fails.

You're stubborn, he thought. Jack must complete his mission on time, but is hindered by your grip who wants to join in on his mission. Don't know what to do, and almost an hour you two were like this.

He is worried, and annoyed with your attitude. He knew you were scared when you saw the bloody gruesome scene, but you insisted on following him. He tries not to yell at you at that time.