Spark is massive overkill for the vast majority of needs. Can't fit the data on a computer, like your use case? Yep, good for that.

Anything else, and it's not worth the overhead. Dask doesn't require a JVM cluster with executors and name nodes and hdfs and everything else that keeps databricks in business.