Harbor is a containerized LLM toolkit that allows you to run LLMs and additional services via a concise CLI.
Repository: https://github.com/av/harbor
Reply on news.ycombinator.com