It wouldn’t be too hard to create a physical device that can only be used to set up and retrieve Authenticator-app style 2FA codes.

All you’d need is a camera to read QR codes, a display, a few kB of storage and some pretty basic processing.

But then I guess that storage would need to be encrypted with some sort of authentication. Hmm.