Even if we count interstellar travel as possible, why would you think we progress especially fast ? Maybe the hyper advanced aliens had already had to deal with thousands of human-like civilization and are not scared because they can handle us (if only by watching us self-destruct in real time)