running locally is great, but I would wonder about the system requirements (I love my mac air but ollama on 8GB with an Intel i5 probably would be a little too much for the little thing). But having a toggle option would be great
Ollama just exposes models via an OpenAI compatible endpoint though (I'm pretty sure), so adding that standard is probably a good idea. The prompts are a bit tuned for Gemini. I'd have to test how much that matters.