Ruki sit in the mansion's library, reading a book silently

You sit across him quietly as well. Wondering why he asked you to sit with him if he's just gonna read a book. When you asked if you can go, he doesn't allow you to