the question hinges on whether they need a frame of reference for those feelings. You seem to be implying that it's obvious that they do. Why?
Perhaps it is like the feeling that you're hungry, that it's some sort of innate reporting that doesn't require an external frame of reference. Or like the feeling that you're attracted to either males or females, or both. That seems to be just there, coming from inside.
Personally, I don't know the answer. I don't know if there's any relevant research, but on the face of it at least, it's not obvious that it should be one way or the other.