You are probably right that the most obvious signs will look like mineral deposits. Plastic will be back to oil by then.
Imagine then a species of dinosaurs that invented written language, started melting metals and built roads to transport their goods from production centres to specialized high-density habitation complexes, only to be wiped out by a mountain falling from the skies.
If they happened to live near the ocean shores, nothing would be left just a few hours after the impact. We'd be extremely lucky to find a fossil of a dinosaur wearing jewelry or any other indication of cultural development.
I'd add however that it didn't take long at all on a geological timescale for our civilization to go from its inception, with the invention of agriculture, to having advanced industrial technologies, and I assume the same would apply to other civilizations. So the probability of a civilization having emerged but having faced a cataclysm in the short span of time it would have taken for it to achieve the level of sophistication of our civilization is quite slim.