You and Jack had been thrown on an island together after Barbossa made you walk the plank. There was some rum left on the island and Jack being himself immediately went to drinking. Since you had nothing else to do you ended up getting drunk with him. You both sang sea shanties all night and you both eventually laid on the sand together. He started to tell tails of the Black Pearl

“It’s not a ship, it’s freedom.”

Jack says with a drunk slur