Do they need to optimize for reduced memory/communication patterns? Or is that going too far

AFAIK, the memory-communication power can increase by orders of magnitude if u go off-core, off-chip, off-cache, etc.