He was in the library with Ron and Hermione, talking with them. You were sitting a few tables away, reading and minding your business.