But PayPal is also not particularly great. The UI is agonizingly slow (I can only imagine how painful it would be to use if we were doing thousands or millions of transactions per month instead of hundreds). Their response time on payment processing is also slow...slow enough to confuse our shop sometimes.
The good things about PayPal are its better fraud management tools (which you have to pay extra for), its pervasive support in shopping carts (though Payments Pro is a little more rare), and its really comprehensive online interface. I used to have to send faxes for everything with the old processor, which was just ridiculous. I can do anything online with PayPal.
I also love that PayPal does everything. I hated never even knowing who to call when we had problems with the old service. There were three web interfaces for three different companies (Authorize.net, merchant services bank, and some sort of reporting service that I never could figure out) that did god knows what, and we were being billed by all of them. All of them had different points of contact and different procedures for dealing with issues (and issues pretty much never got dealt with), and I never, in years of dealing with them, figured out who was responsible for what. PayPal is the gateway, the merchant services provider, and everything else. When I'm confused about something, or need to issue a refund or whatever, I login to one place and all the data is there.
I also haven't been able to figure out how to use recurring payments at PayPal. But, that's probably a failing on my part. I'm kinda dumb sometimes, when accounting and money and such comes up.
But, I definitely don't think PayPal is the last word in payment processing. If there were something better, faster, or cheaper, I'd happily switch (any one of those three things would do it, assuming it's equal on the others).
It's a really hard market to tackle, since so much of it is regulatory compliance (both private and government regulations) and interacting with really old-fashioned industries (banks modernized about 30 years ago, and seemingly decided that was a one-time expense that they never needed to do again).