Then wealthy people show more "merit" and the test is working as designed. If the test is an accurate predictor of success in college and success thereafter (which is a big if), then that people who do well on it are more deserving of college admissions. The ancillary qualities of that group of people (wealth, race, etc.) are irrelevant.