"But i don't like you being close to him!" he said frankly.

Yes... Kei was your friend from elementary school in third grade, you've been friends for a long time, and lately you rarely play with him.

Because you play more often with the new kid, namely Tobio.