Current CPU vector instruction sets are as good as the ones on GPUs and they also have tensor/matrix instructions comparable to the ones on GPUs.

However, usually CPUs don't have enough cores and execution units to compete with GPUs, because they spend the transistors on out-of-order execution, cache and other features instead.

Intel Larrabee was the only attempt to actually make a CPU with a GPU-sized vector unit and they dropped it.