Hacker News Reader

Comment by treffer | Hacker News Reader

I consulted ChatGPT about a bank issue. I didn't have a phone number but ChatGPT was able to spill out a number with a recommendationto call. I verified the number and it was indeed correct (easy: google the number)

I couldn't find the number with searches (I tried before) and I didn't even know that it might be helpful (didn't find it before, so how could I tell) but the AI spilled out and told me how useful it is.

This made me change my mind on search vs. AI. I got what I needed while I was unable to retrieve it with search. It was at least a 10x improvement over search.

But I do think there is space for both.

View on HN

Yeah there is no way I'm giving up my Kagi subscription just yet.

I don't really see ChatGPT as a search engine because I think that's not its strength, though it can certainly deliver in that area sometimes. I like using ChatGPT to clarify information I already have some idea about, and just need a straight forward summary for. This is different than asking it for specific shreds of information. If you treat ChatGPT as an intelligence and not a robot performing reflex over the internet, it's going to be correct often enough. But you always gotta use your head. I don't ask ChatGPT anything that's too far out of my domain of knowledge because, if it gets something wrong, I won't have the Spidey senses to realize it.

The compression can be lossy though and the model often “predicts” complete garbage even with GPT-4. It would be great to get a probability for correctness “Mr. Spock” style in chat - especially so as in case of a telephone number…

You can ask it to also provide a confidence score, though I found it biases heavily towards a high score.

There is an 84% chance we will encounter the force field and become vaporized instantly, Captain.

And rising.

What action would you recommend?

this is also hard for humans. Even with a n shot example this needs complex understanding (same is true for similarity i think).

try yourself ask a random person the similarity between two sentences, without giving them a ruleset or examples.

Even with examples the result very from person to person.

When it comes to diagnosing disease or something, how is AI alone going to compete with a top physician?

I'm talking about a top physician who is of course a leader at using the AI to leverage his own advanced skills, along with contributing to the enhanced training of the model as they go along in a way where each physician's unique input can leverage each other's.

Man in the loop > Loop with no man

Reply on news.ycombinator.com