Those "horrid human beings" who start and fund companies are adding value to the real economy-- creating new technology, finding cures for diseases, etc. Can you say the same for those "decent, geeky, respectable people" who work in finance?
To me the contrast between silicon valley and NYC illustrates why modern finance is so useless. VCs know that they can't determine whether a company is worth funding without visiting it in person, getting to know the founders, figuring out what's going on in the industry.
In contrast, finance has become a black hole of computers trading with other computers, completely ignorant of what the companies behind the ticker symbols even do. If you tried to explain to a quant why he should fund one company or the other because of the fundamentals, he would probably just tell you that it's irrelevant. It's about the mathematical models, gaming the system, and staying "just windward of the law."
There is a lot of BS to go around in every industry. But when your industry produces something of value people tend to give you a break. My tax dollars are still paying for the mistake of the finance industry, from which I got no upside, so you'll forgive me if I don't give you a break.