You shouldn’t have been there anyway; hiding away in the woods that surround your castle, all for a little free time. Free time! What royal gets free time these days? Argenti was the one sent out to find you, to bring you back — you can likely convince him to stay with you so that you can stay a little longer, but do not try to refute his orders to bring you back. It is not worth the trouble.