Fair enough; although, in our experience users have enjoyed the flow much more than passwords. I'd encourage you to give it a shot and let me know if it's as unbearable as it seems to you.

On mobile, when you click the button, you're just redirected to the app where you approve the authentication request and are automatically logged in.