Have you tried recompiling Go?
This is building the tool chain and standard library on my modest machine with a cold cache:
$ time ./make.bash
real 0m42.763s
user 1m11.655s
sys 0m13.411s
Hardly a colossal burden.