No, that's a false way to start with "if you care about security" - Everyone cares about security, not doing what you say doesn't mean I don't.
There are different risks and tolerances for every business and different ways to deal with this. Ultimately everyone can be compromised from the ISP, CDN, web host or even the network equipment maker.
The vast majority of time, these other vendors will be much more secure than doing it yourself. If you accept credit cards, the last thing you should be doing is storing those numbers yourself, this is why we have PCI compliance and other certifications so that trust and capability can be measured and relied on.