HNHacker News
TopNewBestAskShowJobs

elorant

35,994 karma · joined January 18, 2011

.Net developer

cbarak@gmail.com

submissionscomments
elorant··on The tech utopia fantasy is over
So much this. I joined the web in ’97 and back then we had this optimism that the Internet would make the world a better place because it would act as fertilizer for ideas and critical thinking. Some three decades later it’s obvious that this didn’t happen and I’d dare say that social media made the world a worse place. And it’s something that I’m thinking quite frequently the last years trying to figure out what went wrong or if we were just naïve.
elorant··on Claude AI built me a React app to compare maps side by side
Good luck debugging it on production.
elorant··on AMD's CPU sales are miles better than Intel
Well I’m not surprised. If you want a CPU with only performance cores Intel has no offerings anymore.
elorant··on Trump wins presidency for second time
We Europeans have to start developing our own defense strategy independently of US influence.
elorant··on AMD outsells Intel in the datacenter space
Upgrade cycles at datacenters are really long.
elorant··on First images from Euclid are in
Perhaps that's what's required to have intelligent life spontaneously appear and evolve to our level.
elorant··on The Retreat to Muskworld
They certainly don't have more data than Mercedes which has from taxis to lorries and everything in between.
elorant··on The Retreat to Muskworld
Because he needs to maintain market value. Musk is part inventor and part salesman. He needs high valuations to keep risky endeavors afloat. What's better than sell the future.
elorant··on We've entered the AI grift era
So here’s my theory. Everyone will start generating content by the buckets so web site numbers are going to double or triple over the coming years because you’d need somewhere to put all that content. There will be short term benefits for a variety of occupations related to building and maintaining web sites. So before the bubble bursts the web will see a new renaissance era.
elorant··on OpenAI and Anthropic Revenue Breakdown
So 75% of the revenue is from subscriptions? Where are the enterprise users? Are they in Microsoft’s revenue through Azure?
elorant··on AMD GPU Inference
I doubt it, but the 3090 is a four year old card which means it might have a lot of mileage from the previous owner. A lot of them are from mining rigs.
elorant··on AMD GPU Inference
Probably the 7900xtx. $1k for 24GB of RAM.
elorant··on AI chipmaker Cerebras files for IPO
The chip is huge. It wouldn't fit in any conceivable PC form card.
elorant··on Do AI companies work?
We have ideas on how to leverage it. But we keep them to ourselves for our products and our companies. AI by itself isn’t a breakthrough product the same way that the iPhone or the web was. It’s a utility for others to enhance their products or their operations. Which is the main reason why so many people believe we’re in an AI bubble. We just don’t see the killer feature that justifies all that spending.
elorant··on The Collapse of Self-Worth in the Digital Age
How about integrity? Do you find that relevant? Usually people with integrity have high self-esteem because they adhere to a certain set of ethics. I'm not trying in any way to pass judgement, just to give you a different perspective.
elorant··on Hezbollah pager explosions kill several people in Lebanon
If you lost half your gut or a kidney or had your stomach punctured you may be alive, but you’re definitely not battle ready. And you may never be again. A device that explodes in such close proximity to a body is more than certain that it will damage some internal organ. All these thousands of Hezbollah militia are forever incapacitated. You didn't kill them, but they can't hurt you in the future if let's say you decide to mount a full scale invasion on Lebanon.
elorant··on Hezbollah pager explosions kill several people in Lebanon
It surely is because you corrode your target’s trust in technology. They moved from smartphones to pagers, now they’ll have to find even cruder types of communications.
elorant··on Hezbollah pager explosions kill several people in Lebanon
Pagers could have certain security options that would interest only a military organization. We don't know at which stage these were intercepted. They could just as easily be targeted to Hezbollah from the beginning of the sale. Advertise something that could be catered to them and once they take the bait go ahead and booby trap them all
elorant··on The Subprime AI Crisis
Why would non-geeks want to run a local LLM? Electricity prices alone are quite high. Why not pay a subscription on a cloud service and be done with it.
elorant··on The Subprime AI Crisis
As it has been mentioned numerous times in the past, we are not the average user. I don't know anyone outside our bubble who would bother running a local LLM, or going into all the trouble building an x8 GPU rig to run one of the biggest models.
elorant··on Serving AI from the Basement – 192GB of VRAM Setup
The motherboard has 7 PCie slots and there are 8 GPUs. So where does the spare one connect to? Is he using two GPUs in the same slot limiting the bandwidth?
elorant··on Classifying all of the pdfs on the internet
Anna's archive has some 300M pdfs.
elorant··on WD announces enterprise 128TB SSD
You can get a 30TB nvme at about $3k. So that’s probably four times that? I would guess around $15k.
elorant··on OpenAI: Cofounders Greg Brockman, John Schulman, along with others, to leave
That AI will be democratized with the free models and every big player like OpenAI will implode at some point because they’re burning too much capital.
elorant··on OpenAI co-founder John Schulman says he will leave and join rival Anthropic
Who cares about the interface? Not everyone is interested in conversational tasks. Corporations in particular need LLMs to process their data. A restful API is more than enough.
elorant··on OpenAI co-founder John Schulman says he will leave and join rival Anthropic
They aren’t in terms of profitability, but they are in terms of future revenue. If most early adopters start self-hosting models then a lot of future products will be build outside of OpenAI’s ecosystem. Then corporations will also start searching how to self-host models because privacy is the primary concern for AI’s adoption. And we already have models like Llama3 400B that is close to ChatGPT.
elorant··on Groq Raises $640M to Meet Soaring Demand for Fast AI Inference
How is throughput per watt affordable? Each card has a TDP of 275 watts, and a maximum draw of 375. If you try to run a big model like Llama-3 400B you're looking at a cluster with 1,8k cards, and a total power draw of nearly 500KWs per hour.
elorant··on Groq Raises $640M to Meet Soaring Demand for Fast AI Inference
They provide those numbers too. Memory bandwidth is at whooping 80 TBs/second.
elorant··on Groq Raises $640M to Meet Soaring Demand for Fast AI Inference
There’s no comparison between those two though. You can go and get an RTX 3060 with $300 and run Llama3 8B. To do the same with Groq’s chips you’d need to buy 25 of them at $20k each. To run something like the 70B model you need at least $6M in hardware.
elorant··on Tomato nostalgia as I relive my Croatian island childhood
I live in Greece. While a lot of what the article says resonates with me, there’s a small detail that changes everything. Climate change. The last two years I haven’t eaten a decent tomato during summer. We had excessive heat waves the last two years, especially this year the whole summer is with temperatures above 35 which is unprecedented. This wrecks havoc in crops. It doesn’t affect tomatoes only, fruits also aren’t as delicious as they used to be, cucumbers seem tasteless and the list goes on.
← PreviousPage 8 of 34Next →