"In a 21 March 2011 email to customers, RSA essentially admitted that the information stolen from their internal network could allow an attacker to compromise a SecurID-protected system without having physical possession of the token."
http://en.wikipedia.org/wiki/RSA_SecurID#March_2011_system_c...
So passwords are a bad idea, but I'm not sure if I want to replace a problem with a different one.