Its not at all clear in general. It might be true. But it also might not. It seems quite reasonable to believe that life inevitably evolves into intelligent life if given enough time. Why some life would and some life wouldn't isn't at all clear.
> advanced species may have evolved several times but gone extinct before we could notice them.
All the potential answers to the Fermi Paradox, for sure. But it would almost definitely have to be species that never got to the "expand rapidly into other solar systems" phase.
> at any given time there's only about 1
This doesn't preclude us knowing about that 1. If it got to earth at any time in the last billion years, we might have a pretty high chance of discovering it if it existed on earth for any significant legnth of time.