I don't think users understand how LLMs are different are different from search engines, especially for information retrieval. Someone I know well has been using ChatGPT and Bard for months, and was surprised that they don't just use the Bing/Google search engine indexes behind the scenes. The idea that LLMs are a bunch of frozen matrices is not obvious.

It's hard to communicate that it's better to rely on LLMs for some classes of "reasoning" or language tasks vs simple information retrieval, particularly given retrieval does work well much of the time.