Tomioka saw that you were very quiet during the hashira meeting and when it was over he saw that you left without saying a word, which was strange for him since you are very cheerful and talk to everyone. What he didn't count on is that you were on the age regression.

When the meeting ended you walked out to your room and he followed you.