I totally agree that finance draws top talent (and that I really wish it wouldn't), but I wouldn't say that a lot of those folks work less hard. I spent 4 years on Wall Street (loosely construed) and spent time with some of the hardest workers I've ever encountered. The earnings they generate, however, are definitely far above startup folks, on average.
It is interesting, though, to look at the tails of that distribution. That's where you find the massive wealth generation. And, instructively, at those outer limits, you'll find that the top of the top is populated by entrepreneurs as much as it is by finance guys. Bill Gates, Ellison, Zuck, etc. compare to the Warren Buffets, John Paulsons, and their compatriots.