Edit: I just realized that your question was specifically about losing a smartphone. I’m not sure if “half a day” is a universal estimate. I can easily imagine that many people would completely lose access to their digital lives because they only realize the implications after the fact. I think I’d need at least half a day just to figure out how to unlock the scooter again after losing my smartphone. I have absolutely no desire to deal with that.
It is taken out more, so you are more likely to lose it. I often see people with their phones out on a table in a cafe, or even on a flight while they are asleep.
I think it would be more effort to replace a phone than a wallet. You need to buy a new phone and restore it. With a wallet you might need to make a few phone calls but you can manage more easily until it arrives.