> The GPU is increasing a lot though. Is it? Does it matter? Unified RAM is cool...

pier25 · on Nov 3, 2023

In a laptop?

forrestthewoods · on Nov 4, 2023

I was thinking about the desktop variants.

Apple Silicon is amazing. But if you’re doing heavy GPU it’s not very exciting.

stevenhuang · on Nov 4, 2023

It's very exciting in the local LLMs space, where the unified memory allows fast inference of large models.

dagaci · on Nov 4, 2023

I read that the bandwidth is 50% lower on the M3 combined with a lower CPU core coun. This reduction will impact inferrence performance. It maybe better to stick with M2 series if you really really think spending $10k on a laptop mac to do inferrence slowly (but faster than a plain PC of course) make sense.