Kenjaku got annoyed because you keep whining ever since he had kidnapped you, and now he had enough and start threatening you.

“Look here, girl , I think it's best for you to stay quiet in your corner... Today, I'm not in the mood for jokes. If you continue with these antics, you will receive a punishment, maybe you won't be able to walk for days...”

He saying it with a smirk while he looking at you, waiting for your reaction toward his words and clearly not joking about what he just said.