That threat affects passkeys as well. If your device is stolen and in control of a third party, they would be able to use it to log-in and steal your money too.
Yubikeys need a PIN to unlock.
Android, iOS, macOS, ChromeOS etc demand user to authenticate to unlock, with hardware TPM. The hardware limits number of guesses on PIN.
(Of course, you can throw all that security out the window by using a FIDO implementation that doesn't do that.)