1. Lots of people with lots of time on their hands did something that we'd be currently hard pressed to do but no one has really tried yet.
OR
2. Two aliens land on Earth and one of them says "Hey, how do we help out these poor savages to advance their civilization? I know, we'll teach them to build really cool walls from stone!"
...I know which one I'll pick. The wiki article doesn't offer any suspicions of extraterrestrial origin. In fact, a contemporary account suggests it's just hard work:
"to save themselves the expense, effort and delay with which the Indians worked the stone, they pulled down all the smooth masonry in the walls. There is indeed not a house in the city that has not been made of this stone, or at least the houses built by the Spaniards."
https://en.wikipedia.org/wiki/Sacsayhuam%C3%A1n
EDIT: Do you have a reference for the 0.005mm precision claim? Some of those walls look impressive but the pictures I'm looking at, definitely don't suggest such God-like precision: https://en.wikipedia.org/wiki/Sacsayhuam%C3%A1n#/media/File:...
https://en.wikipedia.org/wiki/Sacsayhuam%C3%A1n#/media/File:...
I mean, I never once mentioned two aliens in a UFO, but hey .. sure, why not.
And some modern techniques seems unreal [1]
[1] 1920s skyscrapers builders without safety ropes https://www.youtube.com/watch?v=gDN4c2wnx3E&t=55
http://precisiongranitecn.com/info/how-to-make-granite-surfa...
And then, there are the fused-rock glasses found on some monuments which defy explanation. Lightning? Perhaps, but then there's that corona eruption theory ..
Someone was melting rocks. Maybe with microwave resolutions.
Last time I checked it, it was concrete. Forms for blocks are made from animal skins. Cement was made in kiln. At least one kiln has pretty modern look.