I used to do that. I did it at a time when we did not understand how limited surface transmission was. I didn't want to remove my mask after the weekly shopping expedition because there was some possibility that viral contamination of the mask surface could be a vector. In addition, I wanted to avoid wiping my hands near my mouth or nose, and simply leaving my mask on until I got home and could wash my hands thoroughly seemed like a good way to ensure that.