I think at the end of the day, there has to be some protection against unfair competition, even if its not the existing patent regime. On the recent story about SpaceX, someone mentioned that SpaceX keeps trade secrets instead of patents because the Chinese would copy the technology via the patents. That's a form of IP and the concern of copying is the same concern patents address. Even if Elon Musk dislikes patents, he also dislikes Chinese companies ripping them off.
As VC moves into more areas, like life sciences, medical technology, energy, etc, you will see more patents. It's unfortunate if it leads to meritless patent litigation, but the VC's aren't interested in people ripping off their portfolio companies either, so I doubt you'll get strong push back from them on the subject of reducing the amount of patenting within the industry.
That said, the amount of litigation has clearly gotten out of hand. Patent litigation shouldn't be more common than say shareholder litigation or antitrust litigation, etc.