HNHacker News
TopNewBestAskShowJobs

dontwearitout

218 karma · joined December 4, 2022

submissionscomments
dontwearitout··on Modern genetic data suggests pre-humans were a group of only 1,280 individuals
Thanks for sharing, that was a great read. I've always really been fascinated by the aquatic ape hypothesis (https://en.wikipedia.org/wiki/Aquatic_ape_hypothesis), even if it's not widely accepted as fact.
dontwearitout··on Ukraine uses Australian drones made of cardboard
You make some great points and I agree. Low cost autonomous drones swarms aren't scary because they're more lethal than 155mm shells, they're scary because there's no effective defense (yet).
dontwearitout··on Ukraine uses Australian drones made of cardboard
Yes, a software stack to turn these drones into autonomous area denial or autonomous trench clearing tools could be readily cobbled together using mostly open source components. It would be such a tide changer that it's only a matter of time, and god help the poor souls on the front lines.
dontwearitout··on Ukraine uses Australian drones made of cardboard
"You will live to see man-made horrors beyond your comprehension." - Tesla

The prospect of low cost swarms of AI enabled drones terrifies me. If you've watched any drone combat footage from Ukraine you know it's just around the corner, and this is another step in that direction.

dontwearitout··on IBM analog AI chip could give the Nvidia H100 a run for its money
We absolutely can and will in time, but for better or worse LLMs and large transformer models are highly effective and are entrenching themselves. Any competing hardware architecture that cannot port LLMs will have to do a lot of bootstrapping, and will have to have some extremely compelling reasons for people to choose it.

Cutting energy costs by an order of magnitude could be enough motivation, but you'll still need to demonstrate competitive model performance.

dontwearitout··on IBM analog AI chip could give the Nvidia H100 a run for its money
But unless it can directly or indirectly support current transformer architectures (with their huge parameter counts), it's going to critically struggle with adoption.
dontwearitout··on Successful room temperature ambient-pressure magnetic levitation of LK-99
My understanding is that synthesis of the exactly right crystal structure is very hard (for every 10 lead atoms, 1 - the exact right one - needs to be substituted with copper), so the samples are small and inhomogeneous. As a result measuring resistivity won't be illuminating until large amounts of perfect material can be produced.
dontwearitout··on Ask HN: Room temperature superconductor: what to expect?
On the topic of cold fusion, it's being rebranded as Low Energy Nuclear Reactions and is seeing a resurgence in research. We know catalyzed fusion is possible (see Muon catalyzed fusion) and quantum phenomenon in complex crystalline structures is very poorly understood at best - as highlighted by superconductivity. We know nuclear processes can be influenced by solid state structure in rare cases, and don't know the limits of this. I'm not going to claim it's viable as an energy source, but it's exciting when we encounter physics we don't fully understand. Check out https://www.youtube.com/watch?v=ZbzcYQVrTxQ for a great summary of this controversial field.
dontwearitout··on A Theory on Adam Instability in Large-Scale Machine Learning
More correctly: we don't know how to do this efficiently. Biological neural networks don't use backpropagation and work great.
dontwearitout··on More than 75% of Steam games tested are playable or verified on the Steam Deck
Outer Wilds was an incredible, absolutely unforgettable experience for me. What didn't you like about it?
dontwearitout··on Canada plans brain drain of H-1B visa holders, with no-job, no-worries permits
It's very bad for tech in particular. This is a bit dated, but ~84% of Waterloo grads jump ship to the US (https://news.ycombinator.com/item?id=25911922). Put another way, it's a roll of the dice chance that a graduate stays in Canada.
dontwearitout··on Woman with untreated TB finally in custody – held in “negative pressure” room
For anyone in the healthcare sphere rather than tech, yes
dontwearitout··on Nvidia DGX GH200: 100 Terabyte GPU Memory System
Thank you for the detailed writeup with sources, I enjoyed this. I'd somehow never heard of Koomey's law despite working in tech, this is very interesting and directly relevant to the widespread deployment of AI (biological neural networks still blow silicon out of the water for computations per joule).
dontwearitout··on Why the original transformer figure is wrong, and some other tidbits about LLMs
1. High dimensional embedding space is way more vast than you'd think, so adding two vectors together doesn't really destroy information in the same way as addition does in low dimensional cartesian space - the semantic and position information remains separable.

2. I find the QKV nomenclature unintuitive too. Cross attention explains it a bit, where the Q and K come from different places. For self attention they are the same, but the terminology stuck.

dontwearitout··on Yoshua Bengio: How Rogue AIs May Arise
I enjoyed the connection between modern corporate behavior and wire-heading, it's a thought provoking way of viewing capitalism. I also view this as the most likely danger: people or corporations using AI for their own twisted goals, rather than a rogue autonomous agent.
dontwearitout··on Widely used chemical strongly linked to Parkinson’s disease
"Pesticides such as paraquat and rotenone that have been associated with Parkinson’s disease also leave that pathological signature in rodents." - oh good, it looks like these are still widely in use.
dontwearitout··on Widely used chemical strongly linked to Parkinson’s disease
Citation needed, swiss water decaf isn't the only type of decaf on the shelves at my local grocery store.
dontwearitout··on SparseGPT: Language Models Can Be Accurately Pruned in One-Shot
Good open questions. I suspect we'll see models distilled and compressed down to retain most of their "common sense", "core knowledge", and reasoning ability, while stripping out the gigabytes of random trivia most people will never need.
dontwearitout··on Replit's new Code LLM: Open Source, 77% smaller than Codex, trained in 1 week
Probably not out of the box but if some of the local deep learning wizards get a quantized version working well and optimize it a bit, definitely.
dontwearitout··on QuiLLMan: Voice chat with Vicuna-13B
Very impressive demo! FYI https://signup.bondsynth.ai doesn't work, but https://bondsynth.ai/signup.html does
dontwearitout··on First space images captured by balloon-borne telescope
They have a video of it launching on their instagram (superbit.telescope), it looks like it has a very long tether beneath the balloon
dontwearitout··on Brain images just got 64 million times sharper
5 micron voxels is extremely impressive. I'm excited to see where this goes!
dontwearitout··on BabyAGI: An Autonomous and Self-Improving Agent
I haven't used autoGPT but vanilla chatGPT can happily do this in 25 lines of python.
dontwearitout··on BabyAGI: An Autonomous and Self-Improving Agent
GPT is not supervised learning, it is self-supervised learning (a form of unsupervised learning) since the learning objective is "fill in the missing training data".
dontwearitout··on Ageing studies in five animals suggests how to reverse decline
I've been very interested in David Sinclair's work at Harvard on the Information Theory of Aging: https://www.youtube.com/watch?v=cLZEEOZlTzo&t=357s
dontwearitout··on Arrest made in SF killing of Bob Lee – alleged killer also worked in tech
The AI research community on twitter is absolutely great, that's the only reason I have an account.
dontwearitout··on The long, slow death of global development
I assume they mean "atoms" as in physical material. I think they're saying physical sciences are stalling out and computer science is responsible for most growth now. I'm not familiar with this term though, and disagree with the sentiment.
dontwearitout··on Anthropic’s $5B, 4-year plan to take on OpenAI
It's fairly recent, I think I saw an article here on their purchase of the domain for a few million
dontwearitout··on A Baby GPT
I've seen you pop up and recommend Hopf algebras and your paper in several deep learning threads here on HN. I am interested in your work, but find the topic very opaque and unintuitive (despite a background in physics and CS). Do you have any recommended educational resources for a gentle introduction to this?
dontwearitout··on What was the impact of Julius Caesar’s murder?
...what?
← PreviousPage 2 of 3Next →