5,351 karma · joined January 11, 2021
For example, skills with sales are far more important than actual software engineering.
The fact someone else may have licenced content for commercial use doesn't entitle someone else to do the same without paying for it. That's the whole point of copyright law.
So that means shipping higher quality, faster, with more features, and for a lower end price.
Doesn't do much to help with the "VPN that uses random consumer PCs and phones" traffic.
The real breakthrough would be reprogrammable key legends in something like e-ink.
While he thinks most businesses can build useful AI infrastructure in just two or three racks, he feels many will struggle to get it running.
“The question becomes: how do you do that?” he said. “The question that the enterprise struggles with is: ‘Where are my kernel engineers? Where are the people who worry about the underlying network? Who can make sure that the model is clustered on GPUs that are close to each other in network proximity? Who can make sure that you’re doing the right caching of results so you get an incredible response?’”
Has he heard of “agentic AI”? You simply fire up Claude or ChatGPT and ask it how to do all of the above.Most of the cost is depreciation on the GPUs and the HBM.
The one number you need to figure out is how much it costs you to buy that GPU and HBM, then how many tokens you can sell from it over its lifespan which is generally amortised over 2 years.
Other providers also charge similar prices (who are obviously not subsidising anything) for running DeepSeek models on their own infrastructure.
OpenCode Go sort of provides a "subscription" which will let you use DeepSeek but they're extremely transparent about what they're offering.