Even if you keep track of location history, Google can get it wrong anyway (I know, because I gave up the idea of having my home address in Google Maps a year ago - it doesn't seem to learn that I've moved out, even after updating my address in Google Pay).