Hacker News Reader

How can I run some inference with this model locally? Do I have to make a huggingface account?

I'm not sure, but maybe GPT4All will eventually add support for it: https://gpt4all.io/

if you can't figure it out send me an email and I can help you figure it out