8,382 karma · joined June 5, 2014
"Heck no! I'm going to climb up a tree, cut the soles off my shoes, and learn to play the flute."
----
[ my public key: https://keybase.io/fenomas; my proof: https://keybase.io/fenomas/sigs/Atl3PLLibVbXFjUYH5sW3DCzCxSf-YFzXh3DB2fqs6k ]
Now please sit a moment and reflect on what you've done. :P
(Aside: it's better not to be pedantic, but if you must be pedantic you should remember to be correct as well.)
> Fen's law: copy-paste is free; abstractions are expensive.
edit: I should add, this is aimed at situations like when you need a new function that's very similar to one you already have, and juniors often assume it's bad to copy-paste so they add a parameter to the existing function so it abstracts both cases. And my point is: wait, consider the cost of the abstraction, are the two use cases likely to diverge later, do they have the same business owner, etc.
FWIW, personally I think it muddies things to frame the question as if "..using statistical token generation" was a limitation. NNs are Turing-complete, so what LLMs do can just be considered "computation" - the fact that they compute via statistical token generation is an implementation detail.
And if you're like most people, "can cognition happen via computation?" is a less controversial question, which then puts LLMs/cognition topics easily into the "in principle, obviously, but we can debate whether it's achievable or how to measure it" category.
Then the "Literature result" columns have a citations for where similar published results were found. The ones with no "Literature" column, like in the first section, are cases where no similar published results have been found (implying that the solution would not have been trained on). Note that in some cases a published solution was found but it wasn't similar to the AI's.
(this is all explained with more detail and caveats at the top of the page)
The term of art for that is steelmanning, and HN tries to foster a culture of it. Please check the guidelines link in the footer and ctrl+f "strongest".
> We went from 2 + 7 = 11 to "solved a frontier math problem" in 3 years, yet people don't think this will improve?
All that says is that the speaker thinks models will improve past where they are today. Not that it's a logical certainty (the first thing you jumped on them for), and certainly not anything about "limitless potential for growth" (which nobody even mentioned). With replies like this, invoking fallacies and attacking claims nobody made, you're adding a lot of heat and very little light here (and a few other threads on the page).
Basically it's an engineering tradeoff. There is more demand for LLMs that can solve open math problems, but can't count the Rs in strawberry, than there is for models that can count letters but are bad at everything else.
If anybody really wanted a model that could multiply and count letters in words, they could just train one with a tokenizer and training data suited to those tasks. And the model would then be able to count letters, but it would be bad at things like translation and programming - the stuff people actually use LLMs for. So, people train with a tokenizer and training data suited to those tasks, hence LLMs are good at language and bad at arithmetic,
Emoji originally came from Docomo phones in Japan around 1999. (Or I think those were the first ones actually called "emoji"; some other earlier devices had similar character sets.)
Source: I worked there at the time and knew the relevant PMs.
E.g.: https://i0.wp.com/www.themarginalian.org/wp-content/uploads/...
(I think later in life his signatures lost the cigarette)
Other sites with animated 3D models might be useful for visualizing the topology of knots, or something. But for actually tying the knots I find this site and its curated photos much more practically useful. The fact that it's not literally animated is a feature; it shows the key stages you go through, rather than every detail.
And the photos are just clearer and better than any other resource. (If you look closely you'll see a lot of editing work has been done on them like to minimize the diff between consecutive photos.)
Only downside is that I wish it had more minor knots!
The quote (from Dijkstra) is that asking whether machines think is as uninteresting as asking whether submarines swim. He's not saying machines don't think, he's saying it's a pointless thing to argue about - an opinion about whether AIs think is an opinion about word usage, not about AIs.
It sounds like you didn't find any issues with either of them, except that the VST vendor chose not to protect the thing you were hoping to crack?
This is an abjectly silly thing to say, and people who push back on it are not gaslighting. Homosexuality occurs naturally and it's not even rare - it's far more common than red hair, for example.
Calling something like that "abnormal" isn't in the domain of fact, it's purely a side-effect of what you label "normal".