I use CUDA for finance based Monte-Carlo simulations. Unless you are at a place with a huge cluster that you have access to, some problems cannot be solved without CUDA.
When precision is needed CUDA is much less useful, say you're running 10^10 simulations then with single FP precision you will only have a result accurate to 5 significant figures.