I'm a python fan, but for something mission critical where there was the slightest chance I had to refactor, there's no way I'd use an untyped language when I could use a strongly typed one.
Are you sure they moved from Scala to Python or they're just Python shops using Spark? (I strongly suspect the latter)
Probably the latter, just pointing out that the health of Spark doesn't necessarily say a lot about Scala's health in the long term.