It does work as expected for me, no matter how I visit the URL. (The first time I viewed the page, I ctrl-clicked the URL.)
> There really shouldn't be much that's different between those two requests except for the referrer header.
I don't know the details, but I gather that that's a big component of the anti-hotlinking system.