Hacker News Reader

Is there any OSS model that is good for function calling? Gorilla LLM comes to mind. Not sure if it's actually good at specifically the function calling api though.

View on HN

Yes, Functionary: https://github.com/MeetKai/functionary/ MIT Licensed

Its actively maintained as open-source. You can even run it with llama.cpp

Mixtral and some Mistral-7b fine-tunes seem to do alright on function calling.

Reply on news.ycombinator.com