You will do what I want because I have gone out of my way to ensure you have no other choice... But it wasn't my fault mind. Just following the incentives.
--Silicon Valley/VC
--Silicon Valley/VC
The Tyranny of Meritocracy - Michael Sandel
This is on my list of books to purchase for next time I'm at the store. Been watching some of his lectures and interviews, and at the core, part of the problem is this incentive structure we created through meritocracy. That common social convention would have it be that those at the top deserve their earnings, they deserve our reverence and deference, similarly for those at the bottom, though shunning and shame is their reward. But what we get wrong is that there are things beyond our own (their) control. Those at the top would not be, were it not also for some luck along the way and the contributions of a great number of other people. Likewise, those at the bottom are not there only of their own doing and also need the help of others to rise from their circumstance.
One example that most seem to connect with is targeted advertising. This is where the search and social media feeds ended up following the incentives. The goal was to maximize profit, which mean selling ads, and humans unleashed an algorithm to do that, which followed the incentives and hill climbed to push users' anxiety and fear buttons, because that drove up engagement and ad dollars. Search was a bit different, but followed the same pattern. Today's search results are so very bad and largely gamed.