People trust legal advice generated by ChatGPT more than a lawyer

It is suggested that again this is an effect of training towards "sounding well" as opposed to alethics.

The results in an image: https://dl.acm.org/cms/10.1145/3706598.3713470/asset/95dbaf8...

--

From the actual paper ( https://dl.acm.org/doi/10.1145/3706598.3713470 ):

> We used ChatGPT-4o to generate the LLM-generated prompts, while UK-based lawyers generated the lawyer-generated advice

It would have been nice to also have layers assess the LLM output...

A man who [uses the stochastic average of the publicly-accessible Internet as his] lawyer has a [future convict] for a client.

Would be good to know if ChatGPT is better or worse than an average lawyer. I'd bet when it comes to a bit more obscure law knowledge, it's unbeatable.

Not a chance at the moment, and not for the future as far as I can see it.

I commented on a similar point in a duplicate post: https://news.ycombinator.com/item?id=43819389

Perhaps the mods could combine the dupes.