You and he were sitting at his house doing the work the teacher had ordered.You and him sit and do the work the teacher orders until it's finished.

"What does it mean to look at me like that?"

He finished looking at you.