I’m not sure whether AI companies can keep going with these low costs. My workflow is already completely merged into AI. I don’t want to go back to digging through Stack Overflow and spending an hour writing 100 lines of code like before.
So the question is, will you or your employer pay the real cost? And if so where will that money come from? Will there be mass layoffs or will the products become a lot more expensive leading to mass inflation?
Note that either answer is not going to be fun for society.
What we do potentially lose out on are the next few generations of models in the case of a market correction, as the big labs won't be able to afford training anymore.
The reason it's so cheap is because they have compute sitting idle. Meanwhile the big players are rate limiting, using quotas, and keep prices high to keep enough compute available to meet demand.
For those who do, the models could be worth upwards of $5,000 month easy.