Except the "merits" are essentially "be a white man".

Even in an actual meritocracy (which we most definitely are not in), there are still human people who are the ones picking the criteria, and human people who are the ones evaluating others on those criteria. Human people, with all of their explicit and unconscious biases. And, to make it harder, there are many of those criteria that do not have objective measurements.