I always wanted to breeze in, sit down, and say, “so, what are we talking about?” but never had the guts.
I always did the knock-on-door + tell them my meeting time has started and never had an issue, be assertive and people will move quickly. Escalating impoliteness doesn't help anyone except your own sense of self-justice.
Eventually broke the habit, but for the time I was doing it it did break up the previous meeting pretty quickly.