I think you could use Python for CUDA programming (I didn't tried that), see PyCUDA at:
http://mathema.tician.de/software/pycuda
even Matlab has some bindings for CUDA:
http://developer.nvidia.com/object/matlab_cuda.html
Bare in mind however that the original CUDA implementation uses C, so if you want the last drop of performance you will use C.