ParentFull threadcjalmeida·We use Spark extensively. We also use @pandas_udf to run some part of our Spark pipeline through some Python-only ML libraries.View on HN