HNHacker News
TopNewBestAskShowJobs

propelled

1 karma · joined June 23, 2021

submissionscomments
propelled··on [Ask HN] From days to minutes by using Dask and Spark–what else should I learn?
The Julia programming language would help speed up computation.

https://julialang.org/benchmarks/

You can use Julia with Apache Spark and Julia works with Python via PyCall. If you are working with tabular data the Julia SparkSQL.jl package lets you create Spark apps using just Julia and SQL:

https://github.com/propelledanalytics/SparkSQL.jl

Tutorials:

https://propelledanalytics.github.io/Tutorials/