News for hackers. Stuff that matters.

A comment on Maintainable ETL Practices at Stitchfix. Parent comment

Re:Maintainable ETL Practices at Stitchfix by tomnipotent on Saturday June 01, 2019 @08:22PM (#20072656)
ETL can include the destruction of raw data between the T & L. ELT assumes it is retained. This is a legacy from days when storage was expensive and it often wasn't tenable to retain everything.
[ Parent | on HN ]
Re:Maintainable ETL Practices at Stitchfix by unityByFreedom on Saturday June 01, 2019 @09:16PM (#20072867)
We held onto middle data when I worked in ETL 15 years ago. It's normal to save data in the middle for unit testing and lookup tables. I agree with GP this doesn't need a new term.
[ Parent | on HN ]