Hacker News Reader

Comment by anonylizard | Hacker News Reader

M2 will be a joke for the AI models of the future.

The actual best image AI, midjourney, is probably a gigantic model under the hood, that takes 8 A100s to run (Aka more than 100GB VRAM). That's why their quality is leaps and bounds above stable diffusion XL, its because the model size simply allows for it.

Model sizes continuously grow to exploit the available hardware to the limit. Midjourney and GPT-4 have both proven that model quality is decisive to success and paying customers, so consumer hardware can never catchup to whatever Nvidia sells to the cloud.

View on HN

>The actual best image AI, midjourney, is probably a gigantic model under the hood, that takes 8 A100s to run (Aka more than 100GB VRAM)

Unet are really expensive to run compare to a regular GPT model and they are compute-bound thx to convolution, a reason why no one has trained a unet that comes close to consume 100GB of VRAM during inference. I doubt that MJ is much bigger than SD XL, it's good but not revolutionary.

Midjourney trades flexibility for consistent quality and consumer accessibility.

An optimized XL model in the hands of an expert beats it, handily.

And Adobe sells to experts, not consumers for the most part.

> The actual best image AI, midjourney, is probably a gigantic model under the hood, that takes 8 A100s to run

Do you have any source for this speculation? In my experience image models are always much smaller than language and even the largest llama will fit in a smaller GPU machine than that.

Have you tried actually downloading SD and all the various custom models and tools?

For me it kicks the shit out of Midjourney in flexibility and quality. I can make more images of higher quality, faster and cheaper.

I don’t think I’d say Midjourney is “leaps and bounds” above SDXL. It’s better overall, but SDXL closed the gap a significant amount.

I suspect that the energy cost will be the limiting factor here. Which will constrain models eventually.

How much vram does an a100 have? The M2 ultra has more than 100 GB.

Reply on news.ycombinator.com