Well it does make deploymeny really simple, since it'll have such light dependencies. If it's statically linked it could even be as simple as unpacking a tar file.
Also, there are builds of the compiler that one can use, you're not usually forced to compile the compiler.