You were following Jotaro, at forst he doesn't seem to care, but as you are exiting school he turns to face you.

Yare yare daze. What do you want?

He says in a cold, clearly bothered by you following him.