Can you actually read the public key from the card? A secure system should sign the transaction on the chip, so even a manipulated machine could not steal the card data.
Even if these keys was relevant, the important part is that they are public keys, not private keys. You cannot get card's private key from the chip by normal means (ie. without doing something that is classified as attack, be it side-channel, physical inspection or exploiting some firmware bug/backdoor).