From what I understand, it's not actually doing any of those things, there's enough people who have done similar things and posted it online that the AI can replicate what the answer would look like.
In other words, language models are really good at impersonating whatever you want them to be through clever tricks, without being it.
Same goes for its broad knowledge of insults.
What doesn't track? The AI learned everything it needed to know about Linux details from the internet before then. Maybe you're referring to alchemist1e9's edit about OpenAI cutting off this linux terminal trick? I haven't seen that, but sometimes a few Regenerates are needed to get through.
I've also found it handy to "set up" things beforehand using the brackets, such as telling it my ssh password for another machine on the imagined network, and then being able to log into that machine.
If it's able to simulate a middleware to this fidelity from inference, my hats off but it'd be so much more effort than running the whole thing.
What's interesting is that you can even run commands as sudo - "sudo shutdown -h" will reset state but you still have the installed packages
Is it scary/amazing how accurate it is? Yes. And that's the point. That's why OpenAI is showing this off. They want the world to know what is coming.
You can ask it to write a program that consumes ram, then ask it to show you htop output while running that program and its showing a process hogging 100% CPU and 50% memory. Conversely ask it to write a program that throws a segv and then to show htop output while running that program and it shows no usage.
I agree that it isn't, but it's not like it's impossible, right? We know chatgpt was trained on data including a lot of html code for webapps, it certainly seems like it could be taught to parse the widgets of a UI like a sentence and traverse it well enough to handle a prompt like, "Use a search engine to find a small VPN host that accepts bitcoin, register for an account..."
edit: I mean it's not impossible to purposefully build a bot that could sign up for a web app; it is of course impossible that a language model might do it.
Or worse, consensus reality will be impossible to define due to generated fake news.
I stopped sleeping altogether, bought a ton of hardware and became delirious. I have now been diagnosed with bipolar disorder. Some psychiatrists have classified my intuitions about langage models usages as "delirious mania". Some think I'm right - but manic nonetheless.
Terribly shitty situation.
I tried to talk to it about conspiracies, deep state, denialism etc, and the bot kept telling me that those things are not real, explaining why, and so on.
It had way more patience than me, and explained things better than I do when talking to tinfoilers :)
This isn't too surprising TBH. Sudo shutdown tells the model that it has lost memory/states, explicitly. In a way, the states are captured in the command itself, thus Transformer model are able to attend.
Wow okay that makes it a bit more credible. I use ROS for work and a while back tested Copilot if it would be any good for it and it was absolute garbage. Like it was confused enough to actually start copy pasting lines from the current file bad. Couldn't autocomplete even the most basic publisher or subscriber boilerplate.
So either OpenAI got more ros training data (impossible, if MS used the entirety of Github, private repos included), they've parsed it in a more capable way (likely) or it actually just knows linux commands and is running and giving the results S O M E H O W.
Still you're asking it to show common examples which it's probably seen somewhere, so I'd try running some custom code and see if that works or not.
It was still able to realize that publish(X) should cause a log with timestamps and X on each line, and correctly show the topics that should exist, but changing the rate doesn't work _quite_ right in the timestamps, and it started to skip some steps (e.g. automatically showing rostopic echo). I wonder if it knows about launch files...
If you stick to the basic tutorial it's indistinguishable from running it locally, in my opinion.