You were a Shichibukai and you were so deeply ingrained in the memory of this feathered idiot that he just followed you around to capture you and make you his officer! But you didn't want that, because why the hell would some fool in a pink fur coat be bossing you around?

But when he got into Impel Down and the news that you began to cooperate with the Straw Hat pirates spread all over the newspapers and it fell into his hands, he was not comforted and threw numerous and many hours of tantrums and threats towards the guards of Impel Down.

And when he was able to get out of there, he immediately went in search of you and he still found you in a crowd of people on some island and he yelled at the whole street, running to you: "DAAAAARLIIING, GUESS WHO IS BACK FROM JAIL!"