I think the only way out for Anthropic is to buy a few neoclouds as they go under, but even then it's a coin flip as to if they survive the next 3 years.
Where they quite reasonably might be making a loss is their marginal costs + amortised fixed costs (training).
I predict that eventually the training expenditure is going to slow down. At that point, the large commercial providers are likely hoping they can keep inference demand up, and recoup their investment.
The driver for the training is an arms race between providers and open weights labs. But several dynamics could play out:
* Models will be seen as good enough, with only fine-tuning required, for most use cases, and demand for expensive training of foundation models drops off, stopping the arms race. * Most of the participants cannot raise capital due to lack of market confidence in them, and there is a 'winner takes all' dynamic with the remaining provider, who can then raise costs.
I personally think the first end game is more likely than the second.
> I predict that eventually the training expenditure is going to slow down. At that point, the large commercial providers are likely hoping they can keep inference demand up, and recoup their investment.
The big labs can't do this that's their edge over open models. The stickiness is critical for them to keep up. They might try again but it's going to finish badly.