Nowithstanding the fact that your answer is totally unhelpful: I thought about it for a second and I think the answer is basically that if you have a multithreading cores and you're pending on the results of another operation, then you can't necessarily know what optimizations you can do ahead of time because you don't know what other threads are resident on your core, which will affect the on-the-fly reorganization.
If you can write better LLVM plugins then I'm sure Intel and HP will be happy to throw lots of money in your direction.
I've toyed around with the older Epiphanies though, and they were definitely easier than GPUs in many respects.
OoO is much more expensive to implement than simply scheduling a different warp to hide latency.
Maybe you're confusing the GPU's threading techniques for OoO?