The problem is the revenue model. Zombie viewing is more profitable than surprising new content.
If you were asked to hack on YouTube's algorithm, any modifications you'd produce, no matter their merit, would be tested against the status quo for their ability to generate revenue.