Gemma2 has gotten good enough that it's competitive with copilot and is completely self hostable. Companies are starting to publish full size base models too. I think the time to bring your AI service in house is here.