Are they all qualified speakers who are insightful and sharing something I can learn from? In that case, I wouldn't mind one bit.
The boss interrupts the HR person. "You know, I've had it with all this affirmative action and diversity crap. It's a waste of time. Let's just stop all this. I just want to interview the best qualified person."
The HR person says "Ok, boss." The next day Jane shows up for the interview.