For something this big and far away you'd think there would be a way to cheat.

It's not as if things are going to move massively if you move your head a bit, you should be able to precalculate things to an extent.