This is a really good idea. It means there needs to be standard way to specify the relevant location for a note inside each media format.
https://www.w3.org/annotation/
It says web annotation but it was born out of an open annotation initiative. The fragment selector supports the most common media types