I think the reason people so vigorously defend the use of standardized test scores in admissions is that we all have a built in bias towards viewing quantifiable comparisons as inherently more objective because it's easy to justify how you arrived at a decision. After all, who can argue with a decision based on one number being larger than the other?
The problem though is that this approach doesn't really remove the subjective, complex elements at all, it just moves them from the decision step to the measurement step. Sure, an SAT score is just a simple number. But how the test is constructed to arrive at that number is much more complicated. And the value of a simple score comparison is only as good as the process of constructing the test, leaving you with the illusion of having made the decision simpler and more objective when you really just move the complexity behind a curtain.
In tech terms, I think the analogy is project managers trying endless different ways to measure software development performance. Number of tickets closed, "velocity", commits, releases, etc, (lines of code if you're very unlucky), all give you nice simple numbers to look at. And while they're not entirely useless, it's easy to become overly reliant on them and assume they are more objective measures than they actually are.