Small shops, in my experience, have more time and labor available than money.
> by the time you start to outgrow the capacity of amazon hosted services, you're generally past the point where it's worth it to host your own.
That's one of my points. There is no such point. The bigger you become, the more money you'll save by doing it yourself. Read the Dropbox migration story:
https://blogs.dropbox.com/tech/2016/03/magic-pocket-infrastr...
Also, if this were true, then why aren't Google, FB, Amazon, Microsoft, Alibaba ... hosting their infrastructure on cloud providers (even their own) ? I assure you at such scales, money becomes a very strong argument. And yet all are choosing to not do this, as far as I'm aware.
The bigger your scale, the stronger the argument becomes to not use cloud.
> And while bare metal may be cheaper, when you own bare metal, you own it 24x7 - you can't scale your infrastructure 3X to handle daytime peak load, or scale it 10X for a day to handle end of quarter processing then scale it back down the next day and stop paying for all of that hardware.
Can I make a slightly sarcastic remark ? This cloud scaling is only useful if your credit card can handle 50x the charges. (there was an article to the tune of "cloud: when will we get to the first $500 page refresh ?", but I can't find it right now).
But perhaps better put, since it's cheaper to own and manage 10x the bare metal capacity than it is to cloud rent 1x that capacity, for any non-trivial amount of capacity, this argument does not mean anything. Add to that that 10x the bare metal capacity has lots of advantages, from technical debt ones, like lower lock-in, to financial ones, you actually own the capital.
I don't understand the argument you're making very much at all. It's not self-consistent. Half of what you say can only apply to super-small companies, and half could only apply to the very very large. And when you're in either argument, you say you agree with my objections to the other part. That not doing cloud is cheaper for very large customers, and that cloud doesn't matter for the very small.
There is a usecase for cloud, but it would never support the cloud providers: if you have a load that suddenly requires 1000x capacity and then doesn't require any capacity for at least a month, then cloud makes sense. So, you're a startup oil driller that needs to crunch through geological survey accoustics, sure, by all means. But if people used cloud only in such cases where it actually makes sense then the companies doing cloud would not be economical ...