Which is probably good you didn't have the guts. Being passive-aggressive-impolite to people won't help them to be more polite about running over others' time.
I always did the knock-on-door + tell them my meeting time has started and never had an issue, be assertive and people will move quickly. Escalating impoliteness doesn't help anyone except your own sense of self-justice.