PyTorch elastic training

We use it for a lot of back-end services that used to be build in C# and ASP. Partly because Python has better supported libraries for a lot of the things we need (even related directly to Microsoft techs), but also because it’s just really productive. It’s not as performance as .Net Core, but we don’t need that as much as we need shorter development/operations time. We can buy more iron, but we quite literally can’t find enough techies.

Luckily everyone seem to treat python as a first class citizen, so it integrates perfectly with our Microsoft heavy tech stack.

One can always fork python to keep it "general" if it ever comes to that. In fact I would argue both ML and non-ML domains would benefit from that fork. The reason python is used in ML is not because its intrinsically good for it, but because it happened to have a good set of libraries and community at the right time and place. Having specialized subset of python fine-tuned/"compiled" for ML would be a good path for it as a product to evolve towards. I would not mind having all kinds of ML related, algebraic operations as part of the language so the code reads more naturally. And not only that, all frameworks have to support that language and thus become much more interchangeable. Just like you can have CPython and pypy and others that converge into the same language, imagine the same thing with TensorFlow, PyTorch and alike converging to a singe language that support builtin ML-operations.

I think the hidden variable here is the affinity of academics for Python. I've never seen so much Python as in universities. It mostly draws converts from MATLAB, and the feel of the language fits nicely onto what they're used to. It's probably the most popular language in education (having replaced Smalltalk and Scheme) and it'll probably stick around for a while.

Other traditional use cases for Python haven't been affected by the popularity of ML so much as the shift towards static typing in corporate settings and competition from new convenience-oriented languages like Go and Elixir, as well as the growth of the Javascript ecosystem. My first real job involved porting an app from Python to Go.