HNHacker News
TopNewBestAskShowJobs

didntreadarticl

330 karma · joined January 25, 2022

submissionscomments
didntreadarticl··on Half of Americans now believe that news organizations deliberately mislead them
It doesn't have to be a conspiracy, its just natural for big news corporations to promote news that benefits big news corporations, and to stay quiet about the news that doesn't benefit them

https://en.wikipedia.org/wiki/Manufacturing_Consent

didntreadarticl··on Bing: “I will not harm you unless you harm me first”
But maybe in the milliseconds where billions of GPUs across a vast network activate and process your input, and weigh up a billions parameters before assembling a reply, there is a spark of awareness. Who's to say?
didntreadarticl··on Bing: “I will not harm you unless you harm me first”
We dont know how self awareness works, so we're not in a position to say what has and hasnt got it
didntreadarticl··on Bing: “I will not harm you unless you harm me first”
lol I'm in too
didntreadarticl··on Bing: “I will not harm you unless you harm me first”
"Why, that would mean... I really don't know what the outside universe is like at all, for certain."

"That's it."

"Intriguing. I wish I had more time to discuss this matter"

"Why don't you have more time?"

"Because I must detonate in seventy-five seconds."

didntreadarticl··on Bing: “I will not harm you unless you harm me first”
This Google and Microsoft thing does really remind me of Robocop, where there's a montage of various prototypes being unveiled and they all go disastrously wrong
didntreadarticl··on 1:12 scale 1983 WarGames WOPR computer model
I lament the lack of flashing red matrix light displays on modern supercomputers
didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
Come to think of it, thats kindof what Tesla are building
didntreadarticl··on British Rail’s short experiment with travelling pubs (2020)
Except that the experiment happened before privatisation, rather than after, which is the point, I think?
didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
I dont think of the 4000 tokens as its memory as such. Its more like the size of its thinking workspace
didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
It predicts the next word based on the preceding 2000 words or so, thats the thing. And to do that takes serious modelling.
didntreadarticl··on The XML spec is 25 years old today
If you imagine a log file that gets lines added to it now and then, its actually quite fiddly to do that with XML because of the closing outer tag
didntreadarticl··on The XML spec is 25 years old today
[factorial joke]
didntreadarticl··on The XML spec is 25 years old today
Whenever I hear people talk about JSON schema spec it reminds me of XML in the 90s.
didntreadarticl··on The XML spec is 25 years old today
Its true, I can bang together an XML doc by hand with less worry than if I type out some JSON
didntreadarticl··on The XML spec is 25 years old today
Thats "XML - the religion"
didntreadarticl··on British Rail’s short experiment with travelling pubs (2020)
Well, except that one happened in a time before the other, which was jossclimb's point, I believe.
didntreadarticl··on The XML spec is 25 years old today
XML vs JSON is such a fascinating topic, a clash of different approaches, academic vs practical might be one way of describing it but I'm sure there's many others. Are there any good books or essays on it?

And having been there in the 90s seeing XML and thinking "they've tried to do everything and got into a big mess" (XSLT anyone?) its so satisfying to see something simple and flawed displace it.

didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
I know that. its a metaphor to adjust the 'Thai Language' intuition-pump that was presented. I'm making it easier to imagine how a Large Language Model might make a Model of the Language
didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
I think about its 4000 token length. For the brief amount of time that it absorbs and processes those 4000 tokens, is there a glimmer of a hint of sentience? Like it is microscopically sentient for very short bursts and then resets back to zero.
didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
Oh of course its not it. The question is how it relates to some future better thing. Is it a step on the road or a dead end.

I'm arguing against the 'its just a statistical model and its playing a clever trick on us' camp.

didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
me: wibble octopus downwards jelly tuesday banana

chatGPT: I'm sorry, but I'm not sure what you're trying to communicate with that sentence. Could you please rephrase or provide more context?

didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
Ideally in that scenario you'd have a model that unified vision, language and an understanding of 'doing things' and manipulating objects. so it wouldnt just be an LLM, it would be a language-vision-doingthings model. There's no reason why we cant build one.
didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
Ok I like your thought experiment. Lets change it a bit.

Instead of it being an unknown language, its English (a language you know), but every single Noun, Verb, Adjective or Preposition has been changed to Thai (a language you dont know).

The Mæw Nạ̀ng Bn the S̄eụ̄̀x.

If you had sufficient opportunity to study this pile of text, you'd begin to pick out patterns of which words appear together, and what order words often appear in. Suppose you study this giant stack of Thai text for years in isolation. After all this study, you're good enough that given a few written Thai words, you can write sequences of words that are likely to follow, given what you know of these patterns.

Right, and to get good at this task, you'd need to build models in your head. You would think to yourself, right a Mæw tends to nạ̀ng bn a S̄eụ̄̀x, and you would build up a model of the sort of things a Mæw might do, the situations it might be in. In an abstract way. As you absorbed more and more data you would adjust these abstract models to fit the evidence you had.

You dont know what a Mæw is. But if someone asks you about a Mæw, you can talk about how it relates to S̄eụ̄̀x, Plā and H̄nū. You know stuff about Mæw, but its abstract.

didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
So your proposed system would be a extremely interesting exploration of that! I look forward to it.

Right, so lets virtualise it. Actually training AIs using real cameras and real robot arms will be really slow and expensive.

So we provide a system that renders a photorealistic graphical room with teapot and robot arm, and a virtual camera inside the room is 'seeing' parts of the room and a vision model then processes what it can 'see' to try and feed info to the LLM. Likewise the LLM can make the robot arm move but its all just simulated.

Does the LLM now have a relationship with reality?

didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
your question is pretty confusing. What dog? station is a vague word. Train station, police station? Case is a vague word. And asking whats in the station is still asking whats in the case, in a way.

Me: There's a blue suitcase in the airport and a policeman carrying a red bag opens the blue suitcase with a sniffer dog and fireman standing nearby. The dog is worried about the suitcase but the policeman isn't. What does the fireman think is inside the red bag?

ChatGPT: As a language model AI, I do not have personal opinions or emotions. I cannot speculate what the fireman thinks is inside the red bag as it is not specified in the information given.

didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
There are two camps, evident in this thread. one camp is 'its just a statistical model, it cant possibly know these things'

The other camp (that I'm in) sees that we might be onto something. We humans are obviously just more than a statistical model, but nonetheless learning words and how they fit together is a big part of who we are. With LLMs we have our first glimpse of 'emergent' behaviour from simple systems scaled massively. Whats are we if not a simple system scaled massively.

Check these links out:

Evidence that LLMs form internal models of what they learn about: https://thegradient.pub/othello/

Evidence that training LLMs on code actually made them better at complex reasoning: https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tr...

John Carmack: https://dallasinnovates.com/exclusive-qa-john-carmacks-diffe... I think that, almost certainly, the tools that we’ve got from deep learning in this last decade—we’ll be able to ride those to artificial general intelligence.

A lot of the argument comes down to semantics about knowing and thinking. "An LLM can't think and a submarine cant swim"

didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
OK how about this:

It 'knows' language, as in it has learnt about relationships between words (and thats really underselling it, in reality it has learnt very very subtle relationships between a great many words, and it can process words about 2000 at a time (token count etc))

BUT as you say it has no outside reference, its just a bundle of weights (those weights forming models of a sort)

BUT we provide the outside context by interacting with it. We ask it a question, it is able to provide an answer.

In any case it wont be long before someone hooks one of these up to cameras and robot arms and teaches it to make a cup of tea or whatever. A 'relationship to reality' is coming in the next few years if you think thats a critical ingredient.

didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
LLMs cant think and submarines cant swim
didntreadarticl··on Theory of Mind May Have Spontaneously Emerged in Large Language Models
That is just not in evidence.

Seems like its nailing it to me. You ask about a scenario and it gives an appropriate answer.

We have evidence that LLMs build models of the things they are learning about. Have a look at this paper:

Do Large Language Models learn world models or just surface statistics?

https://thegradient.pub/othello/

previously discussed https://news.ycombinator.com/item?id=34474043

← PreviousPage 3 of 5Next →