Pure inference would have to compete with other service providers and even local hardware that becomes capable of running models for a price if hardware demand by openAI and Anthropic dwindles.

That is a very commodify market and as such I expect power cost per query ends up setting the pricing.