I can't sign up (because I'm outside the US). I think I could build a local-only version with a local LLM possibly local datasources that would do a pretty good job.
Local LLMs are sufficiently powerful for query expansion techniques so the capability gap there to GPT4/Bard isn't a problem.
They are definitely behind on generative capabilities, but since I'm unable to use the product it is unclear how important that is in this use-case. If there is a video I'd appreciate a link!
I wonder how popular a local version of something like that would be?