Hacker News Reader

I'm new to this whole area and feeling a bit lost. How are people setting up these small LLMs like Yi-Coder locally for tab completion? Does it work natively on VSCode?

Also for the cloud models apart from GitHub Copilot, what tools or steps are you all using to get them working on your projects? Any tips or resources would be super helpful!

View on HN

You can run this LLM on Ollama [0] and then use Continue [1] on VS Code.

The setup is pretty simple:

* Install Ollama (instructions for your OS on their website - for macOS, `brew install ollama`)

* Download the model: `ollama pull yi-coder`

* Install and configure Continue on VS Code (https://docs.continue.dev/walkthroughs/llama3.1 <- this is for Llama 3.1 but it should work by replacing the relevant bits)

[0] https://ollama.com/

[1] https://www.continue.dev/

If you have a project which supports OpenAI API keys, you can point it at a LocalAI instance:

https://localai.io/

This is easy to get "working" but difficult to configure for specific tasks due to docs being lacking or contradictory.

Can you post screens/configs on how setup success?

Or at least state what you configured toward and how?

The documentation gives a quick start and many examples of integration with OpenAI projects like a chatbot. That's all I did.

Reply on news.ycombinator.com