You may hear a lot about trolls and grossly invalid obvious patents making millions in licensing and extortion by legal fees and I agree those things are bad. They are very bad. But the real problem is the apparently valid patents.
Monopolizing a programming technique is a long-term barrier to invention that provides little or no incentive to create anything new compared to all the invention it prohibits. It's the same in any field where experimentation doesn't require billion dollar research teams and each new idea is built on thousands of others. No new work you do in video, audio, or image processing or encoding will be legal without a mountain of licensing agreements. Anything beyond common established software applications will be unlicensable and effectively outlawed. Google had to fight for years with a giant legal team to get permission to release WebM and you don't have that kind of power.