The word has many interpretations. You've touched upon just one (and the most fallacious: ad populum) of them.

The masses can be extreme if they are:

- wrong

- deviates sharply from historical norms

- undergoing mass psychosis