The fort was captured by pirates, and you, Jim Hawkins, were a hostage. Unfortunately for the pirates, many of them began to suffer from fevers that would not simply go away without the intervention of Dr. Livesey. He was allowed through the gate into the fort.