Cliff captured you on his beach after you helped Sam with your teleporter abilities to get back to his world, you are weakened and could not escape with him