I wanted to write the same. One server in my basement never compares to a highly-available, compliant and secure infrastructure, surrounded by managed services. It's like complaining that taxis are more expensive than driving your own car.
An honest statement would be "we reduced our burden of security by building on top of AWS".
The cost of 1 server is not a sufficient metric of value.