This has caused me quite a bit of trouble with my image gallery as well, I've taken to just using exiftool to remove all rotation from my photos, which breaks half of them, and then manually hard-rotating them using ImageMagick, which is technically not a lossless operation if I'm understating it correctly.
I really don't understand why it was decided that most photo viewing applications would honor EXIF rotation, but web browsers would not.