Not only that but it has the potential to change our entire model of computing, and simplify it tremendously. The unification of storage and computing.
Even if all storage uses the same underlying persistence technology, access times will still depend on the distance between the data and the logic. If there are ALUs intertwingled with the storage, access times will still depend on how close the various pieces of data being worked on together are.
Parallel algorithms tend to lose performance as they get chattier and as node speed is lost to increase node count.
Storage living next to logic is effectively a miniaturized version of the "datacenter as a computer" or "warehouse-scale computer" setup that some places are using already. I seem to recall seeing whole books written on the additional complexities of writing software to take advantage of such an environment.
There will never be "only one pool of data". At a minimum, there will be "data in the physical thing that stays on the desk", "data in the physical thing that goes in my pocket", "data on such-and-such private network", and "data available over the Internet".
Those features that are the only things saving modern processors from spending nearly all of their time doing nothing useful while they're waiting for data to be retrieved from main memory.
Look at a Core i7 CPU die, with the L1/L2/L3 cache circled. Understand that many of the remaining transistors are doing things like branch prediction, managing cache coherency, and prefetch and so forth.
http://i.stack.imgur.com/4Z1nU.png
That would be awesome.