I would argue that android "borrowed" a lot from Apple, and that the iPhone was truly innovative in many ways. The question whether they copied too much, or whether Apple's idea were innovative in the first place is what the Patent system is trying to answer.
There is little doubt the current patent system is a big mess. But I see opposing the idea software patents in the same light as opposing patents in general. It is likely that allowing companies to copy everything is good for consumers (at least in the short term), and increases competition.
The question is where you put the line, for example - if Android was an exact copy of iOS, would you still say that it should be permitted?