A physical keylogger is more complicated then messing with the EFI boot partition and adding some persistent code to the initramfs or kernel.
Some people might say they have a detached bootloader (secondary USB which contains the LUKS headers+bootloader), but that depends on them actually keeping the two separate. Even then there is no way to authenticate what you are booting.