Of course, if you need only one machine the cloud is probably not for you. If however you can make use of all the hosted options (CloudSQL, Pub/Sub, ML, etc.) and need scalability (in terms of number of machines used) these services are actually useful.
Example, say you run an online shop that has more demand in certain timeframes (like black-friday or December) you can easily scale your website by spinning up machines, which you can easily stop using after the demand flats out. With own hardware/colo/traditional web hosting you can't do that and holding like 10x hardware for short-term traffic spikes makes no sense.