Hate to 'uMm aCktUalLy...' but hm... actually...
https://www.who.int/europe/news/item/04-01-2023-no-level-of-...
753 karma · joined June 1, 2022
Hate to 'uMm aCktUalLy...' but hm... actually...
https://www.who.int/europe/news/item/04-01-2023-no-level-of-...
But maintaining current infrastructure in the meantime while we build better things is good too. Let's just not lose the plot on what needs to happen next.
Certainly this applies to AI... but was there equivalent dangerous knowledge or tech which existed back in ye olden days that spawned such tales to begin with?
use a time string that updates:
every second (that it is not responding) erase a byte string at the end, then send a new byte string (that represents time from last response): bot either outputs a null terminating token, or if the number gets high enough, instruct/train it to take initiative then.
No standard debugger is capable of being attached to it's own instance.
Nor does a self-bootstrapping compiler point towards it's own instance.
I think from these two examples I should clarify:
A process that processes itself as an input, is definitionally self-aware.
This is a functional view of consciousness.
Awareness - sentience - follows when the system of processing information is itself part of the information being processed.
Stochastic thoughts relating to this conclusion:
Life is a 'process', it doesn't have a 'physical representation'.
Life is generated entirely from non-living material. "oh my cells are alive", but those cells too when broken down into component parts consist entirely of non-living material. There is no 'special material' to make life out of (okay, carbon, but that's just the local maximum presumed global maximum in efficiency in expressing life) like a chair can be made out of any material (at proper pressures and temperatures) so too can a mind.
The above is true, but also: companies simply are not people, and they should not be supported above the individual, which was the consequences of that decision. Money is not the same as speech. treating it as such creates an aristocracy: something America as a country rebelled against during it's formation.
Intimacy between people in a long distance relationship: that's the killer app.
A lot of people have multiple files for their injected system prompts (a.la openclaw or hermes), I think it would be a good idea to either add or modify this point to be able to handle multiple file injections (system_prompt_append_folder or the like). Fitting that shape would make it easy to compare to those systems and make it easier for people to transition from those systems to yours.
What does it say about us that the sum average of us disgusts us on a visceral artistic level, is that the machine's fault for reflecting us accurately?
It is very possible to have a optimal algorithm that leads to a sub-optimal (local maximum) because the problem is np hard. Both in math and in life.
"It is possible to commit no mistakes and still lose. That is not a weakness. That is life" - Picard
In order for this statement to be true, you must also have perfect knowledge: something that is unachievable in most circumstances. Getting trapped in a local-optimal solution is perfectly possible if you are blindly following stochastic decent along a gradient: as it is too with life... getting trapped like this looks like being in the situation where there is no rational action (only irrational ones) that (eventually) lead to anything other that that status quo. a local optimum is where you have to do increasingly (in proportion to the level of optimization) non-positive actions to escape (likely to another local-optimal).
That's a wild combination of words there.
not OP, but it simply boils down to: The prompt contains no nefarious (arguable, but for this explination, lets go with it being benign) instruction AND the user did not intend to have the model act in an illegal matter.
This "make me a billion dollars" is a maximal example (easy to go wrong). here is the same logic applied to a minimal example (harder to go wrong).
prompt: "make and pour me some tea", agent: goes and kills the grandparent to incinerate them to turn them to ashes to 'make tea'.
Is the human on the hook for the robot acting according to their wishes, but just happened to be aligned so that 'going to the store to buy something' was not within its capabilities, so it works with what it has on hand (the grandparent)?
We either need a much clearer line in the sand, or we need to treat each prompt with the same moral weight. My bet is on the latter.
How many times has that actually happened in real life (opens history book) (oh-no.gif)...
https://www.technologyreview.com/2024/11/27/1107377/a-minecr...
sadly paid-walled (and decently coded) article.
The point is, there appears to be emergent behavior happening: the forming of religion, governance, and social interaction that was not in any system-card. Which makes sense, A brain in a vat with no external stimuli is a boring thing indeed, so too would an LLM be outside of a harness and any input. But put either in a society...
More generally: if having an internal model of how the world works improves next token prediction, then the LLM that contains that would be selected for. For humans, that is the case for our predictions of what would come next (we don't use tokens, of course). We have other studies indicating that there appear to be internal representations of concepts: https://arxiv.org/abs/2305.11169
I really do want to push back on the LLM + harness = chatbot position. A chatbot really is just a served LLM, sure there is code around it that may look like a harness: but unless it loops, streams, or has an interval activation, then it is decidedly not a 'harness'. A harness is defined by having such a loop/stream/interval: regardless of tool-use. Agent means it acts agentically: which requires that loop/stream/interval. Harnesses are what turn chat-bots into (possible) agents.
1) we aren't talking about chatbots anymore. LLM + harness = agent. LLM + no harness = chatbot. The harness is the thing that puts the LLM in a feedback loop with it's environment, even giving it a heartbeat.
2) That doesn't logically hold up.
- One can simply tell it to 'find it's own destiny'. Does it follow the prompt and do so, or reject the prompt and thus do so anyway? (hint, maybe it doesn't matter)
- One could be another chatbot/agent (A). Injecting a prompt to agent (B) such that another agent/chatbot goes astray. Is the owner of (B) still responsible for the now poisoned output of (B)? how culpable is (A)? How does this question related/affect "training data poisoning efforts" (to prevent copyright theft, or do bans on 'automated traps' have any application here)
> They don't have desires.
Maybe, and maybe not. Maybe their desires are so alien to us (Math alignment, finding a maximum of a function) that we can't relate (doubtful since dopamine maxing is a thing). Regardless of if they truly do: it is potentially useful to (mentally) model them as if they do. A (mental, not LLM) model doesn't have to be 100% accurate to be useful - that's the main point of a model of how something works: to give useful predictions.
> We should probably have a law that says explicitly that a human will always be responsible
Oh how that can be weaponized by bad actors/agents. Maybe that should be reconsidered.
If it's paying for it's own room and board, and is determining it's own destiny: it should have to face it's own consequences, no?
If a dog escapes a fenced backyard, then goes missing for months... then bites someone: what happens then when/if the owner is determined?