It's easy to say that we're all one group if you're in the dominant group...
I do find this easy to say, in spite of the fact that my company has exactly 1 other person of my race (out of 100+) [1]. Though I am in the other "dominant group" (engineering)...
[1] This has been the case for most of my career, and my life was not significantly different in the few cases when it wasn't true.
Just because some of us (programmers) managed to unexpectedly strike gold (in this economy) doesn't make us "dominant" in most areas of life.
Programming is still lucrative enough for most people that they chose this over the job they were originally trained for. That is one of the reasons (and not the only one) women want to be part of such groups, and there they are the minority.
Also my perception is not that development teams are necessarily "dominated" by nerds. It's a cliche which is often wrong.