Tabby v0.1.1: Metal inference and StarCoder supports
tabby.tabbyml.com
tabby.tabbyml.com
The Tabby team made a significant contribution by enhancing support for the StarCoder series models (1B/3B/7B) in llama.cpp. This enhancement allows these models to run on Metal, providing comparable performance to that of an NVIDIA GPU.