This has been done a lot. Marc Andreessen was going to put it in Mosaic. Hypothes.is is the most semi-well-implemented modern incarnation I am aware of.

Recently, I came across this paper which describes an implementation called "Weblinks" (terrible name) that focuses on just the links. Haven't used it, but it's thoughtfully designed:

<https://dl.acm.org/doi/10.1145/3465336.3475123>