This is one of the bits I remember from reading A Canticle for Leibowitz as a kid. It's about monks in a post nuclear armageddon world. At one point they find an ancient fallout shelter with a bathroom, and they interpret it as a spiritual space where a priest would sit on the "throne" and read "holy scrolls" held by the metal bar next to the throne...
I think we make that kind of mistake when doing armchair archeology or anthropology a lot.
But I think ancient peoples were far more practical and far less concerned over religion and gods than we like to pretend. Sure they might believe lightning are the gods being angry or meteors are the gods taking a dump above the earth or that it is just the nature of existence, they got no real way to explain such things. But that doesn't mean everyone spent all their extra time worrying about such things and furiously producing endless amounts of religious offerings and symbols.