Designers are the gatekeepers though, maybe they should stand up to these folks more often.
Combine the ease of making that argument with potential financial incentives to the designers to optimize for that, then you get relatively easy conformity to that goal. I'm sure there's plenty of designers that will happily accept it, so as a company, you can easily replace any designers that push back.
The world we could have had...
Consider early Google, when they infamously A/B tested 50 shades of blue for a button. Did that actually improve anything? Of course not.