The question is how do you recover it when you lose it?
For a password I just click the “I forgot my password” link, I get an email with a link to click, and my account is recovered within minutes. I have recovered 15 year old accounts this way.
If you can’t do that with passkeys, then the system is doomed to failure because people lose their credentials and devices all the time.