You can find a refuge at Google. You'll need to pick up some programming skills, but we have lots of math-y problems once you're here.
At one time I wrote Fisher Black at GS and got a nice letter back from him, I still have, saying that he saw no opportunities for applied math on Wall Street!
I didn't hear about James Simons until much later.