TL;DR A dedicated CPU is better for a dedicated task over a general purpose CPU that is suitable for all tasks.
Yes the aspect that the Google affair with their TPU, more flexible, whilst not fully general purpose, I'd call them niche purpose. A decade ago we would of just called them co-processors. Time change, buzzwords change, but 8 bits will still be 8 bits.