Take for example this search: https://search.brave.com/search?q=what+are+the+captain+ameri...
Why the paragraph? Just give me a bulleted list! It's hard to read and kinda annoying.
Another issue for me is trust. Web search is oft polluted with web spam (this is not new). Mentally, one can see a URL and skip a site that doesn't have strong authority. So now in RAG, I either need to trust the answer, or I need to look at the embedded citation and find the document and then see if it's trustworthy. This adds friction.
This is also not unique to web search. Private search can also have poor relevance - do I know the LLM is being given the best context? Or is it getting bad context and hallucinating? I need to look at the results to be sure anyway.
I think when used in appropriate ways it can be good. But the experience of "summarize these 10 results for me" might not be the best for every query.