The OS provides functionality to set up the GPU and to compile code for it, and to shove samples into a sound card. That is it.