> One can imagine modifying the compiler to output llvm bitcode. You now can throw plenty of optimisation at it for free (but you are now slower to compile).

If you look at the FAQ, you'll see they can do exactly that but using gcc/Clang, not LLVM.