It sort of is, though: someone's use of a pronoun only exists to the extent that others refer to them that way. My pronouns for myself are I/me/mine. Your avoidance of the pronouns I prefer denies me the "use" of those pronouns. I can't use them without your help.
Not disagreeing about the positive/negative rights characterization. And bigger picture: you're right that this really is about respect. Many people want to demand (even if not compel) more attention to mutual respect; many others want to use disrespectfulness as an indicator of their independence, because they view that as a more important value.