Their current top model is 64 core, but their roadmap is targetting 4K cores or more per chip.
They have local (on core) memory, and a routing mesh to let all cores access each others memory - either for communication or for extra storage, and optionally access the host systems RAM. The chips also expose multiple 10Gbps links that can be used to connect the chips themselves into a bigger mesh.
You "pay" for accessing remote memory with additional cycles latency based on distance to the node you want to address, so it massively favours focusing on memory locality.
I have two 16 core Parallelas sitting around, but have had less time than I'd hoped to play with them.