You can also add PINs to Yubikeys to mitigate the local threat.