I remember google desktop search. It was amazing, even today's win 11 search doesnt come close. So something snappy like that with LLM will be perfect.
PrivateGPT, although more of a proof of concept right now, looks like it could be a nice fit in future