>why would music that is intentionally written to peak in the top 10, require to be musically diverse or innovative?

Of course it doesn't require it, but it's a nice feature.

One feature of good music is that it can surprise the listener (key changes, chord changes, sudden shifts in rhythm or even style).