Re:Launch HN: Metaplane (YC W20) – Datadog for Data
by kzh_ on Monday November 15, 2021 @11:52AM
(#29229469)
Nice work! Love the support for merging profiles together and also profiling unstructured data. I could’ve used this all of the time back in research days, instead of having to do the profiling by hand and from scratch every time.
We definitely want to explore suggesting data tests based on profiling. Don’t be surprised if you see a fork!
Re:Launch HN: Metaplane (YC W20) – Datadog for Data
by big_big_data on Monday November 15, 2021 @10:28PM
(#29236419)
this is cool !! have you experimented with getting this to run on large datasets ? IE: running this with Spark or on your datawarehouse ?
https://github.com/capitalone/DataProfiler
Load any document, profile and monitor the profiles for changes that would impact downstream applications.
Very common problem, you all are in a great space! Very interested and will check out!