One challenge is to load balance programs that are not written in MPI, but instead written in your favorite language. i.e. to load balance a web app.

RAMCloud is a way to bring back Moore's law at this time:

https://ramcloud.stanford.edu/wiki/display/ramcloud/RAMCloud