Isn't the Hadoop story also playing out with spark--the open source version is kinda buggy, while the spark committers at Databricks have retained all the fixes for themselves.