I never figured out graphics cards. They are absurdly powerful and absurdly complex. The lack of documentation and open source drivers also does not help. As featured on HN a bit ago, AMD's drivers for Linux make up 10+% of the entire kernel codebase now!
I have no idea how the developers at Unity or Unreal stay sane. The amount of work that has gone into these base platforms we all take advantage of is...unreal.
https://andybrown.me.uk/wk/2014/06/01/ase/
At a high level it showcases the idea of offloading expensive graphics computations to a separate chip. A modern window manager uses the graphics device in a similar way to avoid redrawing the contents of windows as you move them around the screen.
I think at this point a GPU card is more like a second computer inside your computer. I wonder if we could get rid of the regular computer and use a GPU only... are there any OS for a GPUs?
Nvidia drivers may be closed source, but it just works.