ChatGPT, Or: How I Learned to Stop Worrying and Love AI
lessig.medium.com
lessig.medium.com
I've had some success asking it to poke holes / find weaknesses in an argument it just agreed with. Basically, you kind of need it to play both prosecution and defense in order to feel confident in the resulting conclusion
Lessig is famous, but lawyers -- especially famous ones -- are not known for their resistance to intellectual flattery.
I think it is fair to describe this lack of skepticism as a fatal flaw in the blog post (and a potentially significant flaw in its author). The blog post was supposed to be about how AIs can be convinced by reason, but the author did not actually assess, or show curiosity about, whether reason is a requirement for convincing them in any way. That's not a small blind spot; the mention in the final paragraph of "But I'll confess that this persuadable intelligence has seduced me." seems to be confessing more than it intended to.
However... this article isn't even remotely compelling. It gives you what you're looking for most of the time. No surprises there.
LOL.
Nope.
I have never seen a court (cult?) use reason.
Never.
Here I make it agree with me about some history I just made up: https://chat.openai.com/share/e373193d-001b-4413-9273-cbde3e...
The Weimar Republic (and Hitler's rise to power) has to be one of the most well-documented time periods in German history, yet ChatGPT refuses to spot obvious nonsense and happily hallucinates.
ChatGPT is a useful tool, but you have to be careful about the language you use with it. If you use strong language it will almost always agree, regardless of whether you're making sense. However if you phrase your argument more weakly and with less conviction, it will be much more likely to point out mistakes.
I've found this too.
I often use ChatGPT to explore unfamiliar topics, and I think the custom instructions help a bit.
Something like : "I try not to bias your responses by loading my questions or putting strong opinions in them, but please do contradict or correct me if I'm on the wrong tracks, following bad practice, or making faulty assumptions. Please do have your own opinions."