How often are you using a new device you need to enter your password in that you can't plug a Yubikey into?
Say, can you tell me what the recovery process is if your Yubikey croaks while you're on a trip away from home?
Every option has drawbacks.
As for the yubikey croaking, easy: carry a backup.