You'd need a civilization that did not produce long-lived technological signatures (e.g. glass panes), that did not have a large number of individuals (i.e. produce remains), that did not substantially alter their environment (i.e. leave geographic markers), AND that did not consume easily available resources (e.g. oil/gas or metal ore).
Which is to say... possible, but not very likely.