If you want to program for general GPU devices, you could search for OpenCL (my first comment is valid only for NVIDIA GPU's).
However you should bare in mind that coding for OpenCL is, at least now, an order of magnitude more complicated (personal opinion) than CUDA programming.
With CUDA if you already know C is straightforward to get started.