https://thewaltdisneycompany.com/news/disney-openai-sora-agr...
23,535 karma · joined February 12, 2014
https://thewaltdisneycompany.com/news/disney-openai-sora-agr...
I'd argue the entirety of fictional characters works by this. It would be impossible to write a fictional character if you couldn't "simulate" their behavior in your head to some degree. (Some authors say they aren't even consciously thinking about this, they feel as if they just "observe" the characters and writing down what they see)
> We are a long ways from knowing how to manage humans in a way that prevents them from doing great damage to each other
Predicting and "managing" are two different things. Only because I know someone is an asshole doesn't mean I know how to change him to not be one.
(well, except investment money I guess)
And Grandpa will have fun if he has to juggle 20 passkeys with different security requirements on his devices.
1) There is this new entirely optional feature, but it's not relevant to you, so feel free to ignore it.
2) The feature is now active by default, but no worries, there is a simple button for you to opt-out.
3) The feature is active by default, but because we value our users, there is an option in the advanced settings to deactivate it.
4) Our data shows that 99.9% of users activated the feature, but if you belong to the handful of diehards who still refuse to use it (rolls eyes), you can use this obscure command line flag or about:config entry to turn it off
5) Managing opt-out infrastructure for the feature has significant maintenance and security cost that we feel, we can no longer justify. Therefore, effective in three months, the opt-out flags will stop working and the feature will become mandatory. According to our metrics, this will affect 0.0001% of our users, so no disruption is expected.
The same is true for traditional computer programs. The standard argument against valuing understanding is "well, you don't understand the assembly, processor microcode and the electrical signaling when your program runs either, why do you care about understanding the high-level code then?"
I'd counter this by saying that high-level languages have (mostly!) self-contained abstractions that allow you to "understand" a program deep enough to make accurate predictions of its runtime behavior, answer "why" questions when errors happening and safely make changes to it - without having to understand all the stuff at lower levels.
In contrast, with AI, I see the risk that we lose understanding of both the low- and the high-level structure of things. Then we really end up in "unpredictable alien artifact" territory.
You wouldn't ignore a zero-day announcement either because the formatting is ugly.
I had an instance of the feeling (and also what the OP is describing) when writing a post about a technical question recently.
Previously, I'd have posted the question to HN or Stack Overflow - and, in addition to hopefully getting a solution, it might also become a resource for other people who had the same question. Finally, maybe there would have been some interesting discussion around the question.
Now: Ask the AI. Instant answer, question solved, but also, nothing else.
All the current-generation models can oneshot HTML/Javascript frontends of comparable complexity (though maybe not as polished). The only difference is that you have to specifically ask them, and the result is not embedded in the chat.
It feels like it should be easy to have a harness provide a "show HTML widget in the chat" tool and a skill and/or system prompt that instructs the model to generate such widgets on-the-fly if the response could benefit from interactivity.
What am I missing here?
That seems to be the plan...
Also: Here is our recursive self-improvement hard at work...
The sentence itself makes no sense to me. If it's an illusion, then what does "illusion" even mean? Who perceives the illusion?
I'm with you if you want to say that the idea of a metaphysical entity that is separate from the body and not part of physical reality (a "soul"?) might be wrong - i.e. that our conscious experience is fully caused by physical effects, by the interactions of neurons in the brain and all the other machinery there - and that it might not even be an indivisible whole but might be "composed" of different components.
But that doesn't make any practical difference. We're still experiencing the world, have internal thoughts, memories, feelings, etc. Those things exist. In what form they exist is an interesting scientific question, but that's something different from dismissing them completely.
I have zero qualms about aborting a chat or resetting it to an earlier state, because any potential kind of consciousness that could exist would IMO have to take place during the inference passes, so there is nothing that amounts to "killing" an LLM.
I do try to not be a dick in chats, avoid intentionally subjecting the LLMs to mindfucks etc. This happens to be the far more effective way of working with LLMs (in terms of tokens needed to complete a task) as well.
I do not use character.ai or "virtual friend" services or anything else that tries to anthropomorphize LLMs even more than the training already does anyway. (This is more out of concern for myself than for the LLMs)
I think the whole debate runs to conclusions a bit prematurely, before we even have a good model to understand what happens in an inference pass of a billion parameter ANN with 100 layers of attention modules switched in series.
More generally, I don't like the attitude of encouraging people to be assholes. Suddenly we are in a situation where some people are building detailed simulations of torture and the people who are upset about it are the idiots?
(I still have no love for the EA guys or the rest of the TESCREAL circus. They always had a cultish vibe coming off them, but in recent years, all the masks seem to have fallen. They also consistently make the most un-empathic statements and observations, all in the name of "empathy")
I guess I mixed up different things here - I was thinking about "software dashboards" like Grafana or various Kubernetes frontends.
I didn't know this is still done for dashboards of industrial systems. I think then my annoyance is more that this has never been translated to other areas, like software systems.
One thing I notice is how much efforts had been spent to illustrate both the current status of the system, but also it's overall structure and how the two relate - i.e. the actual components of the facility.
Almost all of the dashboards here have some kind of graph, showing the wiring or plumbing between components, or in case of railway control, the railway lines. The graph acts like a map on which status indicators or switches can be placed.
Compare that to modern software "dashboards" which are full of complicated charts showing various metrics, but almost never show the structure of the system.
For a modern take on this, look at Factorio. Why can an industrial zone with a population of one look more lively in Factorio than an entire simulated city in Cities Skylines?