Which would be fine it more banks used a two tier approach to bank operations. Checking the balance? Username and password should suffice. Making a transaction? SMS token or matrix card or RSA key, all seem fine.
One of my banks (BCR Romania) requires a login with a token for initial access (just seeing stuff, or transfers between one's own accounts) and another token OTP, based on the amount and the last four digits of the destination account, for transfers to someone else.
Royal Bank of Scotland and First Direct use a 2FA device that is authenticated first with your bank card pin (3FA?)
All the devices are the same (across customers and banks), so your card is the second factor, the device is just a reader for it.