There has been active work on this:

https://www.w3.org/annotation/

It says web annotation but it was born out of an open annotation initiative. The fragment selector supports the most common media types

https://www.w3.org/TR/annotation-model/#fragment-selector