Wilbur instructed you to gather resources for L'Manberg, and that's what you were doing. Until Dream stopped you.

"Ah, ah... not so fast." he leaned down behind you, his axe at your neck as he whispered behind you... "Why are you on my land, princess..?" :)