One major downside of Touch ID that is niche but affects me personally is that if your fingerprints get damaged (e.g. by rock climbing, which I do regularly) then Touch ID will stop working for ~1 day while your fingers recover. For this reason I'm planning on getting a device with Face ID or a similar feature next time I buy a phone. The downsides of Face ID you mention are valid, though.