There's a middle ground here that has existed for a long time. Mail hand-written cheques for your bills, deposit your paystub into your bank account, withdraw cash on a periodic basis for daily spending. You don't even need to use a banking card for any of this.
I haven't been to a store that has refused cash and have never been required to use a banking app.