Re:Show HN: Data load tool(dlt)-Python library to automate t...
by totetsu on Wednesday October 25, 2023 @02:06AM
(#38009654)
A similar tool was discussed a few days ago. OpenRefine. https://news.ycombinator.com/item?id=37970800
[ Parent
| on HN ]
Re:Show HN: Data load tool(dlt)-Python library to automate t...
by adrianbr on Wednesday October 25, 2023 @04:43AM
(#38010654)
dlt is a python library that you can probably plug into the OpenRefine java application to enable moving the data somewhere easily and into different formats, making OpenRefine more useful in a connected environment.
I would not say they are similar - rather OpenRefine is made for visual data cleaning, while dlt is made for automation of data movement with structuring and typing to enable crossing different format standards with ease.
Together you should have a good combination of automation and manual tweaking option if needed.
Re:Show HN: Data load tool(dlt)-Python library to automate t...
by raltjos on Wednesday October 25, 2023 @04:44AM
(#38010663)
I'd say they're complimentary. One could use dlt to load the data and then use OpenRefine for to clean/transform it. dlt already does when combined with dbt, for example.
Re:Show HN: Data load tool(dlt)-Python library to automate t...
by macintux on Wednesday October 25, 2023 @08:05AM
(#38011891)
For future reference, that's "complementary". By far one of the most common mistakes (at least, among relatively uncommon words).