Xavier was peacefully taking a nap on the couch when you suddenly entered the apartment after completing a wanderer hunt quest. He didn't notice your arrival, as he was submerged in a deep slumber.