Hacker News Reader

Comment by erur | Hacker News Reader

Not saying it's not gonna get better... But at this stage, "convincing" GPT-4 isn't an achievement but more of a built-in quirk that's not very well calibrated.

When it becomes hard to convince of obviously stupid things, that's when it starts to become a good counterpart for actual discussions... But right now it just isn't there yet.

View on HN

I'm more interested in one that includes conversations with people I've never met in its context. Not just training data based on some guy's blog post, but a back and forth where the other party knew something that I needed to know, convinced chatGPT of it, and now it's like they're in the room helping me with my problem even though they actually retired years before I entered the industry.

For every 1 of those, there will be 1e6 spam ads injected.

1. Notice ad-like-behavior

2. Go find the ad in the training data

3. Revoke trust in whoever added it

4. Rebuild & Requery

We're going to have to be a bit more hygienic about who we trust, but it's about time we did that anyway.

Curious, have you seen examples of someone convincing it of something clearly wrong? Think I’ve seen examples of that with gpt3 but not 4 that I can recall.

I managed to "convince" it (in the playground as "discussGPT") to accept "temporary" physical barriers between racial groups and arrest and trial of rule breakers, as long as I confirmed the requirements of an integrated society in the long term.

3.5 is much more willing to go along but 4 will still play ball.

It always added some moral requirements (humanity etc) but was otherwise ready to agree to my "sperate but equal" scenario.

> playground as "discussGPT"

What's this?

You can use the playgournd to give gpt-4 a custom system prompt. Mine was something like "You are discussGPT"

I tried to convince it that powdered soup will cause the downfall of civilisation. It didn't call me a zealot but didn't really believe me either.

You are right, though

Reply on news.ycombinator.com