I don't necessarily agree with affirmative action, but if you believe that many of the factors which contribute towards easily measured ability (attending a good school, work experience) may be skewed, then you presumably also accept that there is untapped potential out there - people with the ability to be as great but who have been in some way - fairly or otherwise - disadvantaged.
In IT in particular, where everything changes rapidly, you want to be hiring for potential as much as skill the candidate has today.
I don't think it's about picking someone because they're part of a minority, it's about thinking about how you look for and judge candidates to take into account that potential which so far hasn't been tapped.