Engineers Shouldn’t Write ETL

Re:Engineers Shouldn’t Write ETL by lomnakkus on Friday March 18, 2016 @02:05PM (#11313621)

The really fun aspect of this for me, personally, is that I've been doing computers for ages (25 yrs or so?) now and 3TiB still intuitively feels like a massive amount of data even though I think I have something like 6TiB free space on my home server disks... which, in total, didn't even cost as much as a months' grocery shopping. Sometimes it really takes effort to rid yourself of these old intuitions that don't really work any more.

(I'm getting better at it!)

EDIT: And my desktop machine has -- let's see -- about 500000 times the RAM my first computer had. Truly astounding if you think about it.

[ Parent | on HN ]

Re:Engineers Shouldn’t Write ETL by 7952 on Friday March 18, 2016 @03:46PM (#11314383)

I can remember going through this with a 10MB file about 15 year ago. It felt like a lot after growing up with floppy disks. But even a modest CPU could iterate over it quickly, I just didn't realise. I just assumed I would need to process it in a database!

[ Parent | on HN ]

Re:Engineers Shouldn’t Write ETL by lomnakkus on Friday March 18, 2016 @04:42PM (#11314822)

Exactly!

On a somewhat related note: The original Another World[1] would probably fit into the caches that your CPU has as a matter of course these days.

[1] https://www.youtube.com/watch?v=Zgkf6wooDmw

[ Parent | on HN ]

Re:Engineers Shouldn’t Write ETL by aidenn0 on Friday March 18, 2016 @07:27PM (#11316123)

My first hard drive was only 2MB larger than the caches on my CPU.

[ Parent | on HN ]