Does your PGP key stay on the smartcard or is a copy of it transferred to your computer on occasion?
The key can be generated on the smartcard, and it's not possible to transfer it out of the smartcard by design.
(anything that calls itself a smartcard but allows this isn't a smartcard)
If it's a properly designed smartcard system then the key never leaves the card.