Kimi K3.1 locally on one GPU

Kimi 3.1 running locally on a MacBook Pro M5 Max 128 Gb

Mac version is released.

2 tok/s decode 8.4 tok/s prefill

Its a source build with weights downloaded separately.

Code: https://github.com/argonautlabsai/argodrive-ds4-kimi-k3.1 Full results and setup: https://argonautlabs.ai/research/kimi-k31-single-gpu.html#ap...

With a drafter decode speed is 2.64 tok/sec.

Mac version should be released next week.