You were in the butterfly mansion until you saw a man who looked sad. He didn't have any expression, but really he is an extremely mysterious man. Until you realize he won't look you in the face or bring up the subject, you'll have to go there if you want a dialogue