Hacker News Reader

Comment by hi | Hacker News Reader

Keep your data private and don't leak it to third parties. Use something like privateGPT (32k stars). Not your keys, not your data.

"Interact privately with your documents using the power of GPT, 100% privately, no data leaks"[0]

[0] https://github.com/imartinez/privateGPT

View on HN

It’s significantly worse than OpenAIs offerings, and I’m tired of people pretending as though these models are totally interchangeable yet. They are not.

Is this robust enough to feed all your emails and chat logs into it and have convos with it? Will it be able to extract context to figure out questions to recent logs, etc?

In theory, yes.

I've not got it to work yet though, it ends up hallucinating answers to all the questions about documents I feed it.

How does this run on an Intel Mac? I have a 6 core i9. Haven't been able to get an M series yet so Im wondering if it would be more worth it to run it in a cloud computing environment with a GPU.

>Mac Running Intel When running a Mac with Intel hardware (not M1), you may run into clang: error: the clang compiler does not support '-march=native' during pip install.

If so set your archflags during pip install. eg: ARCHFLAGS="-arch x86_64" pip3 install -r requirements.txt

https://github.com/imartinez/privateGPT#mac-running-intel

I’m curious about the response times though, i imagine they will be quite slow on an intel Mac

Having something that could be used with confluence would be so nice. Having documentation written and just asking questions about it.

100% private? Hmm. I think with the amount of paranoia that the folks in power have about local LLM’s, I wouldn’t be in the slightest surprised that the Windows telemetry will be reporting back what people are doing with them. And anyone who thinks otherwise is in my view just absolutely naive beyond hope.

Don't have so much pride in yourself. Nobody actually cares what you're doing. Well, China might.

And this is probably illegal in several countries besides that since queries might have medical information or other protected data.

Reply on news.ycombinator.com