Out of curiosity what jobs need a good CPU but also can't take advantage of a good GPU?

It seems like most of the high performance numerical computing software today is GPU-accelerated. If performance for your job is super important, why isn't your software GPU-accelerated?

I might just be naive but it's honestly hard for me to imagine why anybody would need a good CPU and not also want a good GPU.