I've been this way for at least 3 years and it's not really a struggle in a major metro area. The only times cash is needed is for tipping, and we don't really valet that often or have other need to tip.
Yep - I've also been unintentionally been cashless for the last few years. Part of it is I don't like carrying a purse and like being able to only have my cards stored in one of those card-holders that attach to phones. I do feel guilty about not being able to tip sometimes but most of the time, tipping is done on a card, and my city has raised minimum wage enough that tipping is supposedly on its way out.
NYC is really an outlier on this. Lots of businesses here are cash only, including all 3 pizzerias near my house, all halal food carts, hot dog carts, many small performing arts operations, and most bodegas (unless you're spending $10+).