Misleading title. Should be "This rock solid website is managed by a Raspberry Pi and powered by Amazon S3". Interesting set-up nonetheless.
I also host sites that get quite a lot of traffic on a VPS with 128 MB of RAM with no trouble.
My main concern is that the Pi is powered by an Ethernet controller that is connected to the USB bus, and it might drop out in special circumstances