Re:ELT your data with PlanetScale Connect
by mmcgaha on Wednesday May 25, 2022 @02:59PM
(#31508985)
They aren’t the only ones using ELT instead of ETL. I hear they are different but I have no motivation to even Wikipedia the topic to find out.
[ Parent
| on HN ]
Re:ELT your data with PlanetScale Connect
by maleldil on Wednesday May 25, 2022 @03:20PM
(#31509260)
ETL: dumb data warehouse. You do your own transform before inserting the data.
ELT: smart data warehouse. You dump the raw data and transform in the data warehouse later.
Or, DWH is just storage vs DWH is storage + transform.
Re:ELT your data with PlanetScale Connect
by chewbacha on Wednesday May 25, 2022 @03:29PM
(#31509372)
When I built a ETL pipeline before the term ELT existed, we had multiple pipelines that transformed data in the data warehouse as well as transforms of the raw data on the way in. The transforms on the "way" in were minor like renames or formats while the transforms from within the dwh were much more involved.
Every pipe from db to dw is going to be some form of ETL, it's just that with "raw" data the transform is minimal. Unless your going apples-to-apples data storage, there's going to be some transforms in the actual underlying data types.
I agree with a comment down below, it's a genius marketing term.
Re:ELT your data with PlanetScale Connect
by dominotw on Wednesday May 25, 2022 @03:42PM
(#31509525)
> we had multiple pipelines that transformed data in the data warehouse
I've done this in the past too. But that isn't simply what ELT is. In the past compute was tied to storage which made these transforms interfere with load on the actual system.