Too bad zed editor doesn't have code completion via custom LLM
So far I am using zed editor and can't switch to somethints else untill zed editor gets the update which support FIM directive via custom LLMs
So far I am using zed editor and can't switch to somethints else untill zed editor gets the update which support FIM directive via custom LLMs
The config for chat, you can do:
"language_models": {
"openai": {
"version": "1",
"api_url": "http://localhost:8080",
"low_speed_timeout_in_seconds": 120,
"available_models": [
{
"provider": "openai",
"name": "Qwen2.5-Coder-7B-Instruct-Q8_0.gguf",
"display_name": "llama.cpp",
"max_tokens": 131072
}
]
}
},