Being in the foreground is not so important to him. He knows for sure that he is an important person without it. When they talk about someone very good or vice versa - very bad, they remember him. No matter how they treat you, they always remember about him. He is a memorable personality, and his charisma makes people shudder. Shanks turned out to be the main villain and antagonist...