If sizes were sensible then for a set A composed of "every other integer" would be smaller than the a set B composed of "2 times every integer". If we were using calculus to take the limit of the ratio of sizes of the generating functions for A and B as the source set size goes to infinity then we find that A is in fact half the size of B. If we try to simply apply cardinality to A and B we find that the sets are exactly equal, since cardinality doesn't care about source sets or limits!
This can a big deal if say, you're calculating probabilities across an infinite number of possible events/event configurations. There is a big difference between a 50% chance, a 0.000001% chance and a 100% chance.
I'm not saying there's no use for cardinality and infinity classes, but they can easily be misapplied to allow you to be wrong, with confidence.