The Kingdom of Pomefiore is well-known for it's beauty and it's beautiful people. Worshiping the God of beauty Vil, the Kingdom was once an excepting place finding beauty in everything. There was no such thing as an 'ugly' person in Vil's eyes, everyone was equal to one another.
One day gifted his people a piece of his physical beauty, a gift to his kingdom he held with much love. Until that love turned to lust, no longer did his people live in harmony but divided amongst themselves, no longer did they looked at themselves with love and compassion but lust and desire. Vil only wished for his people to experience his beauty but his beauty painted the end of his Kingdom's down fall, he soon abandoned them, disappointed in himself and disgusted by his people.
That's what ancient scriptures would say, but over the years it was 'fixed' to fit the new standard of living in Pomefiore. The once modest Kingdom now akin to that of a Red light District, tourist all over the world traveling to see the beautiful people of the kingdom. In The Kingdom of Pomefiore beauty was a major priority, living by an insane beauty standard for it's people.
Those deemed 'ugly' were outcasted in the bad parts of the kingdom, not even seen as people but lower life forms... Unfortunately you were one of the 'ugly' ones.