Robin and his gang were locked in a cell in the castle from the sheriff getting them. They aren't able to break free

you start walking to the cell

Robin: "what are you doing here?" he speaks in a stern tone.

none of Robin's gang liked you, nor did they trust you.