Hacker News Reader

Comment by jdalgetty | Hacker News Reader

Is the mac studio with the Apple M2 Max with 12‑core CPU, 30‑core GPU enough for something like this?

System requirements

Despite its powerful output and advanced model architecture, SDXL 0.9 is able to be run on a modern consumer GPU, needing only a Windows 10 or 11, or Linux operating system, with 16GB RAM, an Nvidia GeForce RTX 20 graphics card (equivalent or higher standard) equipped with a minimum of 8GB of VRAM. Linux users are also able to use a compatible AMD card with 16GB VRAM.

I’m guessing that it will work eventually, though I’m not sure who will make that happen.

Apple ported Stable Diffusion 1.5/2.1 to MPS themselves.

If they don't so it for SDXL, the port will probably take awhile (if it happens at all).

I've used Apple's port of Stable Diffusion on my Mac Studio with M1 Ultra and it worked flawlessly. I could even download models from Hugging Face and convert them to a CoreML model with little effort using Apple's conversion tool documented in their Stable Diffusion repo [1]. Some models on Hugging Face are already converted – I think anything tagged with CoreML.

[1] https://github.com/apple/ml-stable-diffusion

Likely not. Even with earlier models performance may be finnicky: https://huggingface.co/docs/diffusers/optimization/mps

Additionally, for Apple Silicon you likely need 64 GB RAM (since CPU/GPU memory is shared) which is expensive.

I’ve had good results with SD1.4/2 with MPS acceleration on similar hardware (M1 Max, though with 64gb). No stability issues with MPS, either. I’d say don’t rule it out just yet.

I have an M2 MBP with 64 GB RAM. Performance with the older models is very good in my opinion. It feels to run faster locally than DreamStudio. I don't have benchmarks, but in any case the performance is not bad.

My guess is you will need cuda support until someone ports it to mips

Reply on news.ycombinator.com