The ICs they use in passports support proper PKI, and are passive. I still have a ~300+ page spec for an Infineon IC commonly used in passports that I got under NDA, and I just don't think most uses call for such security/complexity.
It's important to note that originally the key difference between NFC and RFID was that the NFC-enabled phone was supposed to be able to fall back to power-less operation (inductive coupling) when the phone ran out of juice.