ASICs/Google TPU like things for AI inference/training will be easy to replicate and will have 95% of the power of existing solutions or maybe even improvements. Because they are simple in design.

As far as dedicated GPUs. There is so much additional work in the software side/driver side of thing unless there was a big concerted effort by a single company to build a solid foundation I see it as unlikely. Look at Intel struggling to get their GPUs out there.

Dedicated accelerated cards just for ML though? I believe some already exist/more will come.