That's basically the idea behind SQRL but with public/private key cryptography instead of a password.
By the way what do you do when you have more than one account or when the website wants you to reset your password (because they leaked it again...)?