I think that's the wrong way around. The inner and outer dome follow catenary curves (they only need to support their own weight), and between them is a cone shape, supporting the heavy ornament on the roof. A 'chain line dome' is not a good way of supporting a heavy load on the roof (just imagine how the shape of the chain changes as you hang a weight in the middle of it).
http://en.wikipedia.org/wiki/St_Paul%27s_Cathedral#Structura... , third paragraph.
There is one issue that's NOT clearly answered just looking at the building or its design (not to me, anyway): an arch/dome pushes outward on its supports, not just downward, and requires some inward force/resistance to counter it. This is what the flying buttresses on many medieval cathedrals are for. I don't really see such a structure on the Pantheon, but I notice the walls are a bit thicker at the base. Whether that's enough to counter the expansive force, I can't say.
Clearly, something has kept it up there for two millennia.
A lot of the ruins of Greece were damaged by Victorian engineers securing the stones with iron bars to strengthen them