S3 is only three nines, and EC2 is 99.95%.
That's almost certainly lower than combining reputable VPS providers geo-redundantly, and likely a much higher cost for the "convenience".
And it's not just for geeky pride. You learn the most when things break. Far too many funded startups run poorly architected apps in a single AWS EZ, unlike GP.