LMStudio is so much better than Ollama it's silly it's not more popular.
but people should use llama.cpp instead
and why should that affect usage? it's not like ollama users fork the repo before installing it.
I had no problems with ROCm 6.x but couldn't get it to run with ROCm 7.x. I switched to Vulkan and the performance seems ok for my use cases
MLX is a lot more performant than Ollama and llama.cpp on Apple Silicon, comparing both peak memory usage + tok/s output.
edit: LM Studio benefits from MLX optimizations when running MLX compatible models.
But vLLM and Sglang tend to be faster than both of those.