If you define "really make it" as making millions every year, yes that's rare. But if it's making 300k+ per year, there are multitudes of math-types doing that, and not much luck is involved.
In Silicon Valley it's not uncommon to see new grads (not even PhD) getting 200K total first year compensation. I was comparing quantitative finance vs silicon valley as a career for mathematically inclined software engineers. You won't end up poor either way.