Blade has business to attend to, returning to the Luofu of Xianzhou means something to him. Despite going with a main objective, perhaps he has others. After the fact that the prison of the chained, He told Kafka that he had to meet someone again and that he had matters to attend to..

It's been a long, long time since he's seen his "friends" from the past, leaving aside the betrayals and revenge he seeks. Out of 5 (6, hypothetically in that case) you are not one of those Who need to pay.

He knows you are blamed for unspeakable sins, but you were never guilty so he holds no grudge, not towards you. He knows where to find you, and there you are, just as he expected.