May I know the niche that you are referring to? Also, how do other search engines like DuckDuckGo performs against Google?
I think there are other jobs that probably face this kind of problem, for example: policymakers, management consultants, journalists, nonfiction writers, some kinds of investors. They all need to rapidly learn things in topics outside of their expertise.
I haven't found other search engines much better, although I haven't yet done a systematic test. One thing that puts me off them is it seems from their marketing copy that most alternative search engines like Duck Duck Go are focusing entirely on being a privacy-preserving alternative. I want one that is focused on quality (and customisability), not just privacy.
I tried to install Searx so that I could at least get results from a variety of engines. But I got stuck in some dependency yakshaving so gave up.
The biggest hurdle I found no way around is the content. Not all but a lot of high-quality information is paid. You get access to it as a user but not if you want to index it as a platform. And you need a lot of different providers to have good coverage. That might get easier if you have lots of users, but you do not get users without content. The platform chicken-egg problem.
Profitable niches like Bloomberg’s business information definitively exist but this would not be the high-quality generic search engine you described.
- Downweighting commercial sources and upweighting academic, government, and nonprofit sources.
- Using some measure of quality, maybe even something simple like length + reading age?
- Building big whitelists of quality sites and blacklists of low-quality sites, as picked by human curators and users
Beyond this, perhaps users could plug in sources that are particularly useful for them, including ones they have subscriptions to. I've thought it would be handy to have search results include ebooks, papers, and notes on my computer, for example.
But maybe the userbase of people who need high quality, non-subscription info is too small to get this started.
> a lot of high-quality information isn't paid
Maybe I was biased towards paid content because I did an enterprise search project on scientific articles before.
> users could plug in sources that are particularly useful for them
That could work if you have a local copy of the data which can be indexed. E-Book DRM might be a problem.
> But maybe the userbase of people who need high quality, non-subscription info is too small to get this started.
That was my impression. I almost always got puzzled looks when I described the idea. And most of those people were “knowledge workers”. But if you are a specialist, you already know where to look for the information you need in your area of expertise.