News for hackers. Stuff that matters.
Re:Meltano raises $4.2M seed round by sytse on Wednesday June 30, 2021 @04:48PM (#27693286)
Meltano is a open source platform for automating ELT pipelines.
Re:Meltano raises $4.2M seed round by rad_gruchalski on Wednesday June 30, 2021 @06:10PM (#27694029)
Is there any significant difference from the traditional ETL?
Re:Meltano raises $4.2M seed round by visch on Tuesday July 06, 2021 @08:59AM (#27747902)
The idea is lean towards doing no transformation before loading into your Target Database/Datawarehouse. Do all transformations after the data hits your target database. DEV time is expensive, storage and CPU is cheap now. DBs and DWs are blazing fast now.

You can still only pull the data that you need using Meltano, but you select things on a "Stream" / "Attributes" level. For source DBs this means something like Table and Field level is as granular as you get.

Re:Meltano raises $4.2M seed round by Guest42 on Wednesday June 30, 2021 @08:49PM (#27695219)
I could imagine a scenario where the target server has more capacity and thereby a better place to do the transforming steps.