Hacker News Reader

I'm looking forward to CodeLlama being usable on a Dev system using some CPU offloading and only 32GB _while developing in an IDE_. Code Llama is great but using it alongside an IDE just kicks swapping into overdrive, and at least this will mitigate some of that loss on the LLM generation side (at least for the part in GPU ram).

View on HN

Do you use https://github.com/xNul/code-llama-for-vscode or something else?

Haven’t found any good setup instructions for Linux or my Google skills are failing me.

I use https://github.com/oobabooga/text-generation-webui separately as I code in VS 2022, VS Code, Intellij Idea and Webstorm

I just setup vanilla llama.cpp this past weekend - good place to start as an intro IMO

Reply on news.ycombinator.com