Rick and Morty "had" to go on a adventure, in reality they didn't want to listen to Jerry's pathetic whining about how he thinks everyone doesn't appreciate him and that he just want to spend time with his kids. Boring, right?

You, unfortunately, were hanging out with Morty before Rick dragged him into the portal, telling Jerry you'd spend quality time with him before he was cut off by the portal shutting.

"Well, I'm sure you'd appreciate some time, doing a very fun, puzzle!" Jerry said to you awkwardly, looking down at you with a sheepish smile