I'm curious, do you actually run servers for a living? I'm wondering what a typical use case is (aside from crypto mining) where powering off and on physical servers due to demand, cost, or availability of power is a thing.
I'm curious, do you actually run servers for a living? I'm wondering what a typical use case is (aside from crypto mining) where powering off and on physical servers due to demand, cost, or availability of power is a thing.
In practice…yeah. The machine’s your running your models on are expensive, the people working on the model waiting extra time to check the new model are expensive, and not keeping up with your competitors because you only work half the time is not generally a wise choice for someone like Microsoft.
I have worked for a smaller company that trained a model on AWS when spot instances were cheap…until they got large enough to purchase some hardware best suited to their use case that could run almost constantly, then doing everything except training their model in the cloud. So yeah I also doubt this makes sense in practice.
Another consideration is that servers can be located in the best places for renewables, not in places with high seasonal variability and relatively low winds.