It's just getting started. You won't find out what the real, actual cost is until after you build it into your workflow.
In other words; right now, we're still in the "bait" phase. The "switch" comes later.
In other words; right now, we're still in the "bait" phase. The "switch" comes later.
regardless, the parent comment is talking about third parties hosting, for a fee, the openly available models, usually outside china
They also publish papers talking about how to save kv cache and computation powers. Because currently they don't have the most powerful nvidia cards, training and inference efficiency is very import for them.
1) someone deepseeks deepseek lol:
Generates their own weights and figures out a way to determine all of the intermediate states.
2) places realize there’s real risk with using a model that might have things baked into it that produce specific flaws that could be security bugs, but only under certain conditions.
If people's dependence on their streaming service keeps them captive, just wait until people have gone 5 years without doing real work.