2,745 karma · joined December 30, 2012
The ML field has a good understanding of the algorithms that produce these floating point numbers and lots of techniques that seem to produce “better” numbers in experiments. However, there is little to no understanding of what the numbers represent or how they do the things they do.
There were hints of where Microsoft was heading in Windows 10, but at least a lot of the worst “features” could be disabled.
I find 11 just completely unacceptable software to run on any system I own.
"is more than a X... it is Y" - 3 matches
"not just X, but Y" - 4 matches
> It should go without saying that the best way to increase your practice surface area in a given field is to be obsessed with that field. Obsession makes quick work of formal and bounded training sessions, and it doesn't need "tips" on how to do so.
> So the question then becomes, "How do I increase my practice surface area if I'm not already obsessed?"
https://www.tiktok.com/@dreamrelicc
Before AI, each video on this channel would have taken a large team with a Hollywood budget to create. In a few more years, one person may be able to turn their creative vision into a full-length movie.
If in a few more years, “video games” evolve into hyper realistic VR worlds with LLM-powered NPCs that act like real people, also designed to maximize engagement, we might need to revisit the risks of exposing kids to that as well.
I agree with “let’s hope it remains that way.” But you may be underestimating the fragility of modern human civilization and all the systems that are so effective at preserving knowledge. At the scale of history, most of our technology has only existed for the blink of an eye. It would not take much, really, for all this to go away.
Absent the internet, power grid, and other systems of global infrastructure, absent anyone to take care of the libraries (which are falling out of favor), absent an authority to gather together all the experts with their tightly focused specializations, absent the chip fabs and the global supply network, how exactly do you build a computer? Or even something as “simple” as a pencil?
This is surely the greatest weakness of current LLMs for any task needing a spark of creativity.
People on HN regularly claim that LLMs are useless if they aren’t 100% accurate all the time. I don’t think this is true. We work around that kind of thing every day.
With your examples:
- Before computers, fraud and human error was common in the banking system. We designed a system that was resilient against this and mostly worked, most of the time, well enough for most purposes even though it was built on an imperfect foundation.
- Highly precise clocks are a recent invention. For regular people 200 years ago, one person’s clock would often be 5-10 minutes off from someone else’s. People managed to get things done anyway.
I’ll grant you that Roman aqueducts, seasons and the sun are much more reliable than computers (as are all the laws of nature).
The rigidness and near-perfect reliability of computer software is the unusual thing in human history, an outlier we’ve gotten used to.
At some point we should probably take a step back and ask “Why do we want to solve this problem?” Is a world where AI systems are highly intelligent tools, but humans are needed to manage the high level complexity of the real world… supposed to be a disappointing outcome?
Is this true? I couldn’t find another source discussing it. That would be insane behavior for a package manager.
> As recently as June, the technical problems meant none of OpenAI’s models under development seemed good enough to be labeled GPT-5, according to a person who has worked on it.
But it could be that this refers to post-training and the base model was developed earlier.
https://www.theinformation.com/articles/inside-openais-rocky...