Glass and pottery fragments both last "forever" if they're left someplace relatively dry, or get buried, or otherwise protected from physical and chemical weathering. A glass bottle thrown away on the beach will be eroded to nothing in mere years to decades, but a glass bottle thrown aside and buried by some soil can stay there for millions of years easily. Stone artifacts are similarly robust. These relatively permanent traces get left behind long before a civilization gets "industrial". Pottery and glass predate our own industrial revolution by thousands of years.

For such a civilization to develop and go unnoticed to historians, their influence must have been very small, they must have been geographically limited. For instance maybe they lived in low-lands and rising sea levels erased all trace, but this would still require that their artifacts rarely if ever got carried up hills where they might have been untouched by the rising oceans. It seems deeply implausible.

Certainly there was nothing even remotely like our civilization in the past. There are glass beer bottles laying around on virtually every corner of the planet, on mountain tops, in caves, in landfills. Just everywhere really. It will take longer than a mere few million years to erase all these.