Just because something must yield to you doesn't mean you have an infinite right to obstruct it.
It's quite possible (and likely!) for you simultaneously to have an obligation to yield and the other party to have an obligation to not block.
It's quite possible (and likely!) for you simultaneously to have an obligation to yield and the other party to have an obligation to not block.