You totally missed the point. The mass bombing in WW2 was intentional. That was specifically the goal, to kill as many civilians as possible.
173 karma · joined March 3, 2023
You totally missed the point. The mass bombing in WW2 was intentional. That was specifically the goal, to kill as many civilians as possible.
It can solve math word puzzles that are not in its training set.
Yes you can find these edge cases. We know about these edge cases and that's just missing the point.
There are countless examples of emergent properties in these LLMs which by definition are solving tasks outside of its training set.
Its reasoning has been demonstrated on examples outside of its training set.
"Reasoning" is a much broader term than you think it is.
They routinely solve math problems (and other reasoning tasks) that don't exist in their training set. Examples were in that paper I linked to. This is one of the incredible emergent properties of LLMs / deep neural networks.
Try it out today on GPT-4. Make up your own math problems and go for it.
> At no point does the LLM know that 5+6 = 11
Does it need to "know" that (by your narrow definition of "know") in order to reason about a word math problem?
> if asked to solve a problem in which 5+6 was an implicit component of the solution but not explicitly present in the text, it would be completely lost
Can you provide an example? What makes you believe it can't be trained to solve those too? That's just a higher abstraction over the language. Add more layers, more training, etc. Many humans cannot solve basic math word puzzles that this artificial neural network can already solve.
He means AGI.
https://en.wikipedia.org/wiki/Bombing_of_Dresden_in_World_Wa...
https://en.wikipedia.org/wiki/Atomic_bombings_of_Hiroshima_a...
Yes it is actually modelling the meaning and context around it. ChatGPT is a ~100 layer deep neural network that was trained specifically to solve "natural language understanding tasks". The term "understanding" is an important term in NLP research along with the concept of "semantic similarity".
I believe it is more powerful and ultimately (eventually) more dangerous than you fear it is.
Posted by Jason Wei and Denny Zhou, Research Scientists, Google Research, Brain team
https://ai.googleblog.com/2022/05/language-models-perform-re...
Go tell that to the researchers who are working hard on studying emergent properties.
ChatGPT models semantic relationships in the data. That's what your smart buddy means by "understanding". That is a high dimensional model of the data set which infers abstract semantic relationships / concepts. But he would not claim that those semantic relationships are exactly the same as any human interpretation of the data (which you refer to as the "real" response).
Language models also have limited reasoning abilities. They are capable of misunderstanding as much as understanding.
I truly don't care and not opposed to the term. Just trying to explain why someone might get confused.
It's a new buzzword coined by the marketing team at Amazon in 2014. Somewhat confusing here as you are renting time on a GPU server described as "serverless".
Vinyl sounds blatantly different due to analog distortion in the vinyl mastering and playback mechanisms. The distortion, frequency response, dynamic range, are all significantly different. You must be practically deaf to not hear the difference between vinyl and CD quality.
Yes. So what? Not every business is identical. Some businesses are more greedy and ruthless than others. Some provide more societal benefits than others.
If your function has too many parameters then the code probably needs refactoring.
Yes agreed about DSL in Scala. Scala is complicated. I was a Scala dev for many years. We tried to avoid the more academic and overly abstract designs with that language.
I've never seen that code that needed to be weirdly formatted with its own rules separate from other files in the codebase in order to make sense. That just sounds like a developer being a prima donna with their code style, not something that genuinely improves understanding and collaboration.
When someone commits changes to an existing file, they auto format before committing. If existing parts of the file already contain weird non standard formatting this creates distracting whitespace noise in the pull request that could have been prevented. It's a waste of time to not use standard formatting.
SQL is for relational databases. That's a different paradigm to CQL. The similarity is superficial. CQL is not a dialect of SQL. Not even close.
This does not apply to humans or machines.
By your logic, just pick any random bum off the street, give him the right training set, then he will become a 180 IQ genius and discover the unified theory of gravity and quantum mechanics.
Some models are just inherently better at modelling.
> Expecting people to buy based on an HCL is not reasonable
It's totally reasonable for an OS with ~1% market share.
If you know that much about Linux, you should expect issues with Nvidia. AMD just works.
More realistically, game devs can target Proton as a platform, making sure it works on that.