A motion sensor in the remote could mitigate the issue and maintain convenience.
Edit: some / all of the power drain would be offset because the RF transmitter would be off while the sensor is on.
Years ago, McDonalds was handing out pedometers[1] which had a year+ battery life along with a display in a package smaller than most key fobs.