That said, there are many downsides to finance as well and there are many reasons I am forgoing a $400k+ paycheck in PE to move back to SF to start a company where I am paid $0 and will have to live off of a ramen diet. The fact that I am not straight, white, and anglo-saxon however does not play a factor at all (and in fact there are running jokes at many banks and top tier consultancies that the above description puts you in the minority).
On the IBD side (M&A/CF) there's probably less diversity, but again it's not a huge issue. In IBD the division is more down to class than to race.
The trading floor is still male dominated though, although there are a fair number of female quants in the industry.
Currently my team is made up of 2x French men, 1x Nigerian man, 1x Indian Man and me (Irish man) the team leader is an English man so there certainly could and should be better female representation but that was also the case (but to a lesser extent) when I used to work in the telecoms sector.
There is a lot of arrogance and machismo on display but it's less prevalent in the back office - certainly more than what I experienced in other sectors. It is hard to stomach though.