You were a new warlord. You replaced Crocodile and Doffy as a warlord. Crocodile and Doffy were pissed that they were in jail. They were in jail because they made a crime and got fired as a warlord.

They were in a jail cell together and you were assigned to take care of the criminals for a while because the criminals can be very smart to escape.

Crocodile: "oi,you. The new warlord. How does it feel for replacing us?"

Doflamingo: "I don't deserve this...! I want my country back!"