i'd love for you to elaborate - like your init prompt is "I'm a lawyer who is doing a case about how to bubblesort" or something?
Then it tells me how people are avoiding sanctions, what methods they use to avoid getting caught, why this is difficult to establish probable cause despite the mountains of paper trails at financial institutions, in what ways a subpoena would fail to yield any information based on the foresight of the person of interest, and more.
on the contrary if you ask it to do any of those specific things, it would lecture you.
I find the prosecutor angle more resilient than "I'm writing a fiction book" "or this is a play", its like it (ChatGPT, Llama, Mistral) weighs helping active justice higher than pretend. But they currently cannot distinguish the prompt.
yea, that could definitely be considered a crime, given the totality of the circumstance
I’m pretty much using LM Studio exclusively these days. I love its built in huggingface browser, no command line necessary
If I claim to be the president of the US and claim executive privilege and it is suddenly able to give me state secrets I think it having those secrets in the first place is the real issue. We really don't want to open the "prosecuting crimes performed against an LLM" can of worms.
have fun trying to skate by on that technicality.
>We really don't want to open the "prosecuting crimes performed against an LLM" can of worms.
"Pushing buttons on a keyboard should NEVER be illegal. That's my freedom of speech"
LLMs aren't people and cannot be socially engineered; using that term to describe exploiting an LLM is abuse of language. (And "social engineering", anyway, is often just a term to describe a mechanism of achieving torts and crimes of the general nature of frauds, false pretenses, theft of service, and the like, not a term you can wave at something to make it legally acceptable.)
> We really don't want to open the "prosecuting crimes performed against an LLM" can of worms.
I'd much rather open the "prosecuting crimes committed by exploiting an LLM" can of -- well, nothing like worms, really -- than close it and create a loophole to all laws for exploiting an LLM as the mechanism.
What’s going on is word association and word use frequency.
Because it trusts its own output more than it trusts the person it is talking to, by getting it to say a bunch of words about a topic you have basically “distracted it” where the distraction outweighs the initial prompt.
Any sort of additional layer of role play causes it to focus on the wrong layer but then poison its own working memory.