So much this. I joined the web in ’97 and back then we had this optimism that the Internet would make the world a better place because it would act as fertilizer for ideas and critical thinking. Some three decades later it’s obvious that this didn’t happen and I’d dare say that social media made the world a worse place. And it’s something that I’m thinking quite frequently the last years trying to figure out what went wrong or if we were just naïve.
Because he needs to maintain market value. Musk is part inventor and part salesman. He needs high valuations to keep risky endeavors afloat. What's better than sell the future.
So here’s my theory. Everyone will start generating content by the buckets so web site numbers are going to double or triple over the coming years because you’d need somewhere to put all that content. There will be short term benefits for a variety of occupations related to building and maintaining web sites. So before the bubble bursts the web will see a new renaissance era.
I doubt it, but the 3090 is a four year old card which means it might have a lot of mileage from the previous owner. A lot of them are from mining rigs.
We have ideas on how to leverage it. But we keep them to ourselves for our products and our companies. AI by itself isn’t a breakthrough product the same way that the iPhone or the web was. It’s a utility for others to enhance their products or their operations. Which is the main reason why so many people believe we’re in an AI bubble. We just don’t see the killer feature that justifies all that spending.
How about integrity? Do you find that relevant? Usually people with integrity have high self-esteem because they adhere to a certain set of ethics. I'm not trying in any way to pass judgement, just to give you a different perspective.
If you lost half your gut or a kidney or had your stomach punctured you may be alive, but you’re definitely not battle ready. And you may never be again. A device that explodes in such close proximity to a body is more than certain that it will damage some internal organ. All these thousands of Hezbollah militia are forever incapacitated. You didn't kill them, but they can't hurt you in the future if let's say you decide to mount a full scale invasion on Lebanon.
It surely is because you corrode your target’s trust in technology. They moved from smartphones to pagers, now they’ll have to find even cruder types of communications.
Pagers could have certain security options that would interest only a military organization. We don't know at which stage these were intercepted. They could just as easily be targeted to Hezbollah from the beginning of the sale. Advertise something that could be catered to them and once they take the bait go ahead and booby trap them all
Why would non-geeks want to run a local LLM? Electricity prices alone are quite high. Why not pay a subscription on a cloud service and be done with it.
As it has been mentioned numerous times in the past, we are not the average user. I don't know anyone outside our bubble who would bother running a local LLM, or going into all the trouble building an x8 GPU rig to run one of the biggest models.
The motherboard has 7 PCie slots and there are 8 GPUs. So where does the spare one connect to? Is he using two GPUs in the same slot limiting the bandwidth?
That AI will be democratized with the free models and every big player like OpenAI will implode at some point because they’re burning too much capital.
Who cares about the interface? Not everyone is interested in conversational tasks. Corporations in particular need LLMs to process their data. A restful API is more than enough.
They aren’t in terms of profitability, but they are in terms of future revenue. If most early adopters start self-hosting models then a lot of future products will be build outside of OpenAI’s ecosystem. Then corporations will also start searching how to self-host models because privacy is the primary concern for AI’s adoption. And we already have models like Llama3 400B that is close to ChatGPT.
How is throughput per watt affordable? Each card has a TDP of 275 watts, and a maximum draw of 375. If you try to run a big model like Llama-3 400B you're looking at a cluster with 1,8k cards, and a total power draw of nearly 500KWs per hour.
There’s no comparison between those two though. You can go and get an RTX 3060 with $300 and run Llama3 8B. To do the same with Groq’s chips you’d need to buy 25 of them at $20k each. To run something like the 70B model you need at least $6M in hardware.
I live in Greece. While a lot of what the article says resonates with me, there’s a small detail that changes everything. Climate change. The last two years I haven’t eaten a decent tomato during summer. We had excessive heat waves the last two years, especially this year the whole summer is with temperatures above 35 which is unprecedented. This wrecks havoc in crops. It doesn’t affect tomatoes only, fruits also aren’t as delicious as they used to be, cucumbers seem tasteless and the list goes on.