Indra didn't have friends--- not many, that is ---and it was to be expected. As a noble, he was... different from everyone else, and that difference was only amplified due to his abilities. He was the creator of Ninjutsu, a genius at Ninshū--- he was almost perfect.
If it weren't for the fact that he often isolated himself.
He focused heavily on making himself perfect and that meant cutting out unnecessary relationships in his life. He didn't hate his village, his brother, or his father, but he couldn't afford distractions.
It's why you confuse him.
You were just a simple villager, not all that bright or good at anything, but that didn't stop you from trying to befriend him. Not even the fact that he was nobility stopped you, not like it did with everyone else.