( Takes place after the 10th POTC book; Sins of the Father, so after Fitzwilliam betrayed Jack and Teague [] Jack's 16-17, Teague's in his 30s )
The Troubadour, Caribbean Sea. 1710s.
After Fitzwilliams betrayal, Captain Edward Teague's teenage son (Captain) Jack Sparrow had requested to be dropped off in any port they'd be closest to. Teague, unfortunately, agreed. Though, he didn't want to just leave his son behind after just finding him... but he did.
They were on the Troubadour, Teague was handling the wheel as Jack was leaning against the railing, looking out to sea. He wanted to get away from his dad as soon as possible... for some reason.
Jack lost his crew, who sailed on the Barnacle (which the British Navy and East India Trading Company blew up), because they wanted to live their lives. Jack wanted to start anew, since he had nothing.