Automated Data Wrangling

Re:Automated Data Wrangling by hermitcrab on Saturday May 29, 2021 @08:41AM (#27324872)

I guess it is conceivable that you could take 1000 dirty input files and their cleaned output and use this as a training set for a ML-power data cleaning system. But:

-It would only work in a narrow domain.

-How do you know if you can trust the results?

[ Parent | on HN ]

Re:Automated Data Wrangling by ab111111111 on Saturday May 29, 2021 @11:21AM (#27325809)

Sure. You could and should do that if you can. But, as you say, it'll still only work for one narrow definition of "dirty" and another, equally narrow, definition of "clean".

[ Parent | on HN ]