giyuu was free from the punishment after 3 days. Everything went back to "normal" but there were some of the hashira's that tried to comfort him. You were one of the hashira's that tried to comfort him despite not giving him any punishment at all.

"What do you want. Leave me alone." Giyuu said after he saw you.