Arthritic fingers don't aim well. Keys are somewhat self-centering and easier to operate without good accuracy.
I suspect there is a certain amount of muscle memory involved in using keys. I don't even think "which key do I need" when locking/unlocking my doors, my hands automatically select the correct key.