That's like saying, "We can't stop fighting this war, then all our guns would be worthless."
Now if patents were only used defensively (which they're obviously not in this case, since Apple went on the attack) the analogy would then be banning ballistic missiles right after acquiring a ballistic missile defense system, which would be easier to swallow.
Patents are being used aggressively because that's the nature of competition—if anyone is going to use them that way, everyone has to. But it could be in everyone's interest if that option were removed from the table, regardless how much each had previously spent amassing an arsenal simply to remain competitive.