You need those staggering amounts of compute to run an inference service, but you don't need it to run a powerful model.

It doesn't cost a company that much to buy a box capable of running the Qwen3.8-Flash-Next model in the GP comment and never pay Anthropic again. The cost will be even more reasonable once the supply issue is solved for that hardware.

AI-as-a-service is a unique product because when the interface is natural language, there is no lock in. VS code has a hotkey to swap between claude, openai and a local model. Compare that to the difficulty of swapping from macOS to Windows.