How do you implement emergency certificate revocation?
I have no mechanism at the moment for revoking host keys, which is a harder problem to solve as it would involve updating a number of laptops, phones, etc. that may not be powered on at a given time, but that’s less of a problem since if I knew a host key had been compromised I wouldn’t be logging into it anyway.
Now you have two critical systems to protect instead of one: the Raspberry Pi and the CA.