You are missing the link between rights and duties.I just default to the definition of "right" that's more like "something you can do without needing anyone's permission." I don't accept that anyone is ever obligated to do something (provide me with a gun, for example) because of someone else's rights.
in the negative sense, I have the duty not to stop you bearing arms
No, you could try if you feel justified. But at that point there's no more reasoning from first principles or anything... you just have two sovereign individuals with a dispute over something. The dispute can be settled through diplomacy, force, or whatever. I'd hope it was the former not the latter, of course.
One way to protect oneself is to ensure no one has the means to do harm to each other
Any living human being has the means to do harm to another, including killing them. Killing another human with your bare hands isn't terribly difficult, especially if you catch them unaware (e.g., slap on a rear-naked-choke and simply choke them to death). So by your standard, living itself can't be a fundamental right, since we all have a right to commit genocide (since that's one way to make sure no human can harm another human).