Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve with Exa, the all-new framework local consumer LLM inference and usage!
https://github.com/kyegomez/Exa
And, check out the documentation!