Hacker News Reader

I noticed that offline LLM builds running on personal computers are now possible, but it seemed like all the solutions required the installation of dependencies, so I created a containerized solution that makes it easy to swap out the model in use: https://github.com/paolo-g/uillem

Nice, love seeing Paolo post this! He is a great guy, we used to work together, and I’m excited to see where he takes this.

Paolo indeed is a great guy. Can’t wait to hang out with him next.

This is pretty neat! Now I just need a good library of models to plug in haha

Check out Hugging Face. It's cool to be able to try out different models to see how they perform. RAM requirements can get steep for the larger models.

Very impressive, can't wait to give it a try!

Cool

Uillem – an offline, containerized LLM interface