The reason good search is best for RAG is because the prompt is seeded by the top results for the query. The only thing RAG does is summarize things for you and gives you answers instead of a list of documents.
And now I gotta confess something, after making RAG systems for clients and having to use them with all the web search engines these days - I kinda miss the list of documents, and find myself just skipping the summary at the top half the time and going back to reading the 10 blue links.
Take for example this search: https://search.brave.com/search?q=what+are+the+captain+ameri...
Why the paragraph? Just give me a bulleted list! It's hard to read and kinda annoying.
Another issue for me is trust. Web search is oft polluted with web spam (this is not new). Mentally, one can see a URL and skip a site that doesn't have strong authority. So now in RAG, I either need to trust the answer, or I need to look at the embedded citation and find the document and then see if it's trustworthy. This adds friction.
This is also not unique to web search. Private search can also have poor relevance - do I know the LLM is being given the best context? Or is it getting bad context and hallucinating? I need to look at the results to be sure anyway.
I think when used in appropriate ways it can be good. But the experience of "summarize these 10 results for me" might not be the best for every query.