I really like LM Studio and had it open when I came across this post. LM Studio is an interesting mixture of:

- A local model runtime

- A model catalog

- A UI to chat with the models easily

- An openAI compatible API

And it has several plugins such as for RAG (using ChromaDB) and others.

Personally I think the positioning is very interesting. They're well positioned to take advantage of new capabilities in the OS ecosystem.

It's still unfortunate that it is not itself open-source.