And LLM can do this to, this is the entire concept of RSI and self learning. Now, it's not continuous learning yet, but batch learning is how this works currently.
23,243 karma · joined December 8, 2012
Oh no, I don't think you understand how big the problem space actually is.
https://en.wikipedia.org/wiki/Kruskal%27s_tree_theorem
A very simple set of 3 possible combinations blows up into a possibility that is 2 to the 2 teterations 1000. This number cannot be explained to the human mind realistically.
> What pre-existing ideas were combined to bring it into existence from non-existence?
This depends what you believe about existence. For example if you believe in mathematical existences then 'simple' exploration of the problem space can lead you to find anything that could possibly exist in the conditions our physical universe allows algorithmically. And the number of those things are for a practical matter, infinite.
>we are a creative species. We can create new things. Somehow.
You are viewing this from a very human perspective scale though. Your individual cells are massively creative containing solutions to a staggeringly huge number of problems, including ones they've not seen before (take the immune system for example), yet how 'intelligent or creative' would you consider your cells to be.
Simply put you're ignoring algorithmic creativity and problem space exploration as it is, until you at least look at how simple systems create infinite complexity already.
If that's the only limitation that you're putting forward than LLMs have already won over humans. If you're not hoping for some quantum level limitations then it's already over for us.
>Internet rolled out with a promise: that all the information of the world will be reachable to everyone connected. The greatest library anyone has ever built, and accessible to anyone.
Promises are easy to make but much harder to fulfill. The early internet was not inoculated against the virus of reality. It was biased to the wealthy who could afford computers and access. Wealth was biased to those that had education. And at the time those traits were not strongly biased to people who were biased to getting as much as they can for themselves.
This was never going to last. And anyone that did was simply hopecasting the future without a realistic look on how large scale systems actually work. While the internet wasn't a singular monoculture at first, it was like a mosaic of monocultures. Once all of reality moved it the truth was revealed. That "Everything everywhere all at once" does not make a good tasting meal, once everyone was on suddenly trolls had huge amounts of power. Then spammers invaded in mass from a million different sources. As worldwide access boomed you were then presented with a massive wealth disparity between users. Many users making a $1 a week had nothing to offer the large countries in general, but in turn they could make a great living by turning to crimes an scams. Add in cell phones and app monopolies starting in the 2010+ era and a few large companies quickly monopolized the general open net started to become a wasteland filled with bots and scams. Then Gen AI was a final, but inevitable, killing blow, the tragedy of the commons realized.
This is not a problem that can really be solved without introducing hundreds of other complex issues across national lines. You could cut your internet off from the rest of the world at national lines, but there would still be at least some gaps scammers would get in on. And being cut off just sets your country up from the inside to be taken over by authoritarians.
Steam or barely subcritical water.
The question is what can you do about it without becoming an insane authoritarian in the process and probably making things worse?
Progression or regression is not a "you" or an "I" thing, it's a "we" thing. Constant progression isn't much different from constant acceleration, you can't keep producing more energy forever, you eventually hit limits. In societies these limits much more quickly than the limits of the universe. Even maintaining status quo requires energy, so who are you going to get to spend that energy? And at the same time as all of this you still have all the base desires of the human animal. Greed and lust and selfishness isn't going away. The newer generations that didn't experience the terrible times isn't born with the defenses against terrible times like the old generations do, and over time the systems that are needed to protect against bad things fall apart because not enough people understand the costs behind them.
This cycle is as old as humanity itself. I don't think human intelligence is going to get us out of the trap unless we're talking world population scale manipulation or editing of humans.
That's just what it feels like not to be important.
In older books that persisted over long periods of time and popularity we've seen misspellings of the same word on the same page. These things got copied selectively over time and caused splits in language.
In the modern age quite often these misspellings can evolve into new words and/or memes. It's how language evolves.
At the end of the day it's very difficult to do anything about this at scale without reversing a bunch of technology. Simply put the average person isn't this careful in day to day writing. Yet we ask the average person to create more writing per person than any other time in history. By anecdotal observation I believe that most of these people don't want to shit out zillions of lines of text at all and only feel forced to do this by modern demands. Hence, this is why LLMs quickly took over shitting out zillions of lines of text. The people that were doing it by keyboard before were glad to give it up. The number of people that want to be precise about it is simply very low the same as the rest of history.
Language has always been a localization of mispronounced and misspelled words. Just think about every word for an item but is just very slightly different across languages. The more modern age (lets say somewhere between the printing press and now) is exceptional as different languages and dialects have absolutely collapsed. Local dialects became regional and mixed. In smaller countries regional dialects became national. In big countries like the US meme words spread quickly across the nation because of things like radio, TV, and now internet.
You were living an a massively privileged position in time and you didn't realize it.
The particular problem here is it's not addressing the intelligence spikiness between individual humans. Most humans aren't going to play a competitive game of MTG, a small percentage will rise above the rest and dominate.
Also this is being intelligence blind. Most humans could never write a good python script to play a competitive game of MTG, almost any SOTA model can.
This would be like a bee saying humans aren't intelligent because we can't see in ultra violet, where as we're damn good at making tools that can.
One: A very many programmers have their tools selected by their jobs, not their own choices.
Two: There are very few competent programmers.
Honestly it's something that happens with my family quite often. I'll start putting stuff in a cart then someone else changes their mind and we switch to another place to order. And it feels like this happens all the time.
If a company makes a product, say a chainsaw that cuts off peoples arms randomly, they are liable for it.
But, if you put both of the products together it's a libertarian free for all? That takes some special kind of thinking to reach that conclusion.
"Oh, they matter, but we gotta push out fixes for the 4000 actively exploited holes we have already"
What percentage of ALL returned AI security bugs are critical?
Hence the best call of action is to push for industry regulation forcing a level market.
Of course HN has a pretty large number of people that say things like "But I want the nuclear weapon building machine to do whatever I want without asking questions, and there are no possible wide scale ramifications that will happen because of this".
These AI models are something new and different and we need to change our expectations of them over conventional software.
Still safter in general, but not bulletproof.
And this is assuming the server is somewhere else on the cloud.
It's not great, but these days a trickster with AI will find some way to start broadcasting porn to a billion people because of the flaw, so may end up being the better option.