I don't know whether Rust will ever be the right language for GPU programming, however your take feels somewhat unfair.
Please remember there's a lot of optimizations put in the legacy compilers.
What makes you think Rust compile times won't improve?