I am not sure we have the luxury of only going after primary emitters. I think at this point we have to do literally everything we can.
Also, I read on HN a month or so ago about gas stoves making indoor air quality worse. So there is some upside there too. And if we remove gas stoves then people will probably not care to have gas brought in just for water heaters, and maybe we can avoid an entire type of infrastructure.