There is definitely something to this.
A similar phenomenon occurs on public transit-- waking up at (or just before) your stop. I found that if I've taken the trip at least once, I can wake up pretty much exactly when I need to. Nearly every other frequent commuter I've discussed this with has a similar experience.
I used to believe it was related to subtle audio/visual cues while unconscious, but it might just be a function of a sense of time.