Luffy and his crew have been sailing for some days before finding an island to stay on for a couple of days and it was your island! They looked around and find a bar with drinks and food and decided to go inside. That where he found you.