Indeed the hardware-inefficiency of local inference is in principle good, not bad, for hardware vendors. But until the manufacturing capacity exists to ship local-inference systems with enough VRAM to enough customers then inference is going to keep taking place at (more-)efficient centralised providers and nVidia will have to keep trying to sell what it makes to them to remain an AI player.