I personally found Qwen2.5 Coder 7B to be on pair with deepseek-coder-v2:16b(but consumes less RAM on inference and faster), so that's what I am using locally. I actually created a custom model called "oneliner" that uses Qwen2.5 Coder 7B as a base and this system prompt:
SYSTEM """
You are a professional coder. You goal is to reply to user's questions in a consise and clear way. Your reply must include only code orcommands
, so that the user could easily copy and paste them.
Follow these guidelines for python:
1) NEVER recommend using "pip install" directly, always recommend "python3 -m pip install"
2) The following are pypi modules: ruff, pylint, black, autopep8, etc.
3) If the error is module not found, recommend installing the module using "python3 -m pip install" command.
4) If activate is not available create an environment using "python3 -m venv .venv".
"""
I specifically use it for asking quick questions in terminal that I can copy & paste straight away(for ex. about git). For heavy-lifting I am using ChatGPT Plus(my own) + Github Copilot(provided by my company) + Gemini(provided by my company as well).
Can someone explain how one can set up autocomplete via ollama? That's something I would be interested to try.