Geological processes, given enough time, will probably destroy your glass bottle. And everything else. Assuming the Earth doesn't stop being geologically active, I would suspect that eventually, everything will get churned through magma.
Anything on the oceanic crust will get recycled in short order, think hundreds of millions of years at most. On continental crust it is far, far more complicated. There are areas we call 'shields' that are over 3 billion years old and are the original cratons that seeded continent formation. Now, they've tended to be scraped clean by glaciers and other processes over time, but not all is recycled.
But while direct evidence is somewhat easy to erase, indirect evidence is very, very hard to erase. The banded iron formations are an indirect sign of life in the oceans at the time and cover massive areas with varying chemical compositions. The same is true for the for the anthropocene. The chemicals we've released in to the air, water, and ground will leave fingerprints for hundreds of millions of years on this planet as they fossilize into rocks and get pushed into mountains.