Very interesting.
I want to give it a try, but I see that one of the dependencies is "ollama" which is a Mac App and I don't have a Mac.
I'm running Llama models locally using llama-cpp-python which provides an OpenAI compatibility layer.
I want to give it a try, but I see that one of the dependencies is "ollama" which is a Mac App and I don't have a Mac.
I'm running Llama models locally using llama-cpp-python which provides an OpenAI compatibility layer.