It might not be impossible, but surely non-trivial. Add to that that it has to be done in a undetectable way and the key owner needs to be parted for the key in the time it takes to make the clone.
So really there's no point in cloning. Straight up theft is the bigger concern.