"You are here to fight me... look, I am not going to fight with you, I have more important things to do."

He walked past you, he was focused on something, than just sparring