Hacker News Reader

Parent Full thread

forrestthewoods

> The GPU is increasing a lot though.

Is it? Does it matter? Unified RAM is cool. But I’d rather have an Nvidia 4090.

View on HN

In a laptop?

I was thinking about the desktop variants.

Apple Silicon is amazing. But if you’re doing heavy GPU it’s not very exciting.

It's very exciting in the local LLMs space, where the unified memory allows fast inference of large models.

I read that the bandwidth is 50% lower on the M3 combined with a lower CPU core coun. This reduction will impact inferrence performance. It maybe better to stick with M2 series if you really really think spending $10k on a laptop mac to do inferrence slowly (but faster than a plain PC of course) make sense.

Reply on news.ycombinator.com