With the geology, you want a place where you can firmly reason about what's going to happen over a long period of time. Maybe there would be sites where you can do the thing of putting it into mountains. But mountain geology is not necessarily stable. Consider how mountains are formed.
Your limited choice of sites is more likely to be flat country. (And it'll be desert, in order for the politics to work.)
"This panel member therefore recommends that the markers and the structures associated with them be conceived along truly gargantuan lines. To put their size into perspective, a simple berm, say 35-m wide and 15-m high, surrounding the proposed land-withdrawal boundary, would involve excavation, transport, and placement of around 12 million cubic meters of earth. What is proposed, of course, is on a much greater scale than that. By contrast, in the construction of the Panama Canal, 72.6 million cubic meters were excavated, and the Great Pyramid occupies 2.4 million cubic meters. In short, to ensure the probability of success, the WIPP marker undertaking will have to be one of the greatest public works ventures in history."
Plus, as interesting as this project is, I can't imagine coming across a gargantuan spike field in the middle of the desert that I would not want to explore.
That's an excellent point. It does seem to have been a component of the overall exaggeration of the cost of nuclear power.