However, since I already have pi working with llama.cpp server from a docker container, I did a quick experiment to compare three code bases:
https://gist.github.com/ontouchstart/7483c12efa3c3d3a49e38c2...
https://gist.github.com/ontouchstart/217fe2b8103a5c0bfaee1e9...
Very interesting.
Will do it again next week if I can get unsloth studio working.
curl -LsSf https://astral.sh/uv/install.sh | sh
uv venv unsloth_studio --python 3.13
source unsloth_studio/bin/activate
uv pip install unsloth==2026.3.7 --torch-backend=auto
unsloth studio setup
unsloth studio -H 0.0.0.0 -p 8888
Here is the error message on my machine:
https://gist.github.com/ontouchstart/86ca3cbd8b6b61fa0aeec75...
It seems we might need more instructions on how to set up python (via uv) in vanilla MacOS.
``` ../scipy/meson.build:274:9: ERROR: Dependency lookup for OpenBLAS with method 'pkgconfig' failed: Pkg-config for machine host machine not found. Giving up. ```
Too much work.
https://gist.github.com/ontouchstart/532312fcba59aec3ce7f6aa...