It won't have infinite memory channels, so you end up with 32 cores fighting for memory access on each channel.
I wonder how Linux deals with lots of cores with large-ish scratchpads. You can also add lots of memory channels as well - this is not a desktop part after all - you'll find them in datacenters.