Well, the smooth cover of the pyramids have been stolen and the pyramids have been used as source material for building in the past. So, not stolen in its entirety, but damaged.
What I would think is that some, if not all, of the ordinary stones will indeed by lost, but then surreptitiously replaced by others (after all, they have no identifiable properties).
1300 years from now, there will be stones, but the not the original ones. I think it fits the purpose perfectly, just like purported official Christian relics.