I think we situationally judge "fair queue" by two rules.
1) did my queue block? if so, its "unfair" your queue moves but I was ahead of you
2) if somebody jumps ahead of me, even if I am aware they were in another queue before me, I feel like I've been cheated