Hacker News Reader

Anyone found a good recipe to run this on a Mac yet?

You can run it by compiling transformers from source: https://huggingface.co/google/paligemma-3b-mix-448

Have you seen that work on a Mac? I've had very bad luck getting anything complex to work with transformers on that platform.

Yes, I was able to run inference on the unquantized model in CPU land on Apple Silicon.