Yes, all the other phone manufacturers also have patents. Yes, these also all hold Apple back. That's the deal we make with patents, you invent something, you get a monopoly on producing that thing.
All the other phone manufacturers are basically respecting that deal. Apple is not - they're taking that monopoly and extending it to a monopoly on distribution of software which just happens to run on the device with the thing. This is what anti-trust law, the doctrine of patent misuse, etc should prevent. Either they don't get a monopoly on the things they invented (and all the other phones get better) or they don't get to abuse that monopoly to extract money from people who already purchased the device - i.e. after the patent rights are exhausted.