Honestly, I'd feel very uncomfortable making giving money this easy. Even with a physical wallet, it's still a two-step process.
I'm just trying to illustrate that the amount of steps required is arbitrary and doesn't really indicate security. Sure feeling uncomfortable is fine but at least this way is safer than a physical wallet simply because you can't have your cards or cash stolen and worst case your phone is stolen you can login on a computer and deauthorize the phone (plus you can use a pin).