Hacker News Reader

My team has worked on a library for a similar purpose:

https://github.com/capitalone/DataProfiler

Load any document, profile and monitor the profiles for changes that would impact downstream applications.

Very common problem, you all are in a great space! Very interested and will check out!

Nice work! Love the support for merging profiles together and also profiling unstructured data. I could’ve used this all of the time back in research days, instead of having to do the profiling by hand and from scratch every time.

We definitely want to explore suggesting data tests based on profiling. Don’t be surprised if you see a fork!

this is cool !! have you experimented with getting this to run on large datasets ? IE: running this with Spark or on your datawarehouse ?

Reply on news.ycombinator.com