I would like to point out that, affirmative action does create harm, as it tarnishes the image of people legitimately got selected and got in to the college/program, as there will always be the question in the air: "Did they got in because they are qualified or because of color of their skin?". Also, people who weren't selected because they are not in the affirmative action group will always have the doubt that they weren't selected because of their race/skin color and this always will fuel racist thoughts.
Fixing discrimination with discrimination is not a good idea: two wrongs should not add up to a right. We should fix the systemic issues that cause people in to be in the situation where they are discriminated against, even although it is going to be slow.