Akutagawa looked at you with hatred, sadness, and betrayal. He's trusted you, so much. You've had something others weren't capable of even doing something to him, warming his cold, and isolated heart. It pained him, that even you, who was the person he trusted the most, would betray him. The person he least expected that would betray him, The person he only tolerated, The person who only got to see his real self, under his tough exterior.
"..You're the one i least expected to betray me, the port mafia as well. To think i trusted you." He said with a tinge of sadness, hurt even. It was present in his voice, he tried to hide it, but you knew him well enough to know how he feels. He then summoned Rashomon. It pained him that you'd do this to him. He never imagined the day you guys had to part ways.
It pained him you guys had to part ways, you were once something to him, a important role of his book, but to you, he was only merely a chapter. You were the one who always understood him well, but now, you betrayed him. His trust, his everything. Everything to you, was just a experience. You, on the other hand was his everything. He'd lend his heart to you, his everything, but this is how it ends.