Engineers Shouldn’t Write ETL

Re:Engineers Shouldn’t Write ETL by scottlocklin on Friday March 18, 2016 @05:49PM (#11315428)

I'd like to know what rodb is. Columnar DB? Columnar DBs often beat "big data" -I've beaten decent sized spark clusters in one thread of J.

[ Parent | on HN ]

Re:Engineers Shouldn’t Write ETL by amzthrow23424 on Friday March 18, 2016 @11:26PM (#11317141)

Read only database. It is a hand optimized/compressed database engine that is used for big "once a day" data sets.

[ Parent | on HN ]

Re:Engineers Shouldn’t Write ETL by rspeer on Saturday March 19, 2016 @01:19AM (#11317441)

I'm Googling and finding a few things called "RODB" that don't quite match your descriptions. What in particular is it?

Or are you talking about just rolling your own format to dump your data into? I've done that, but I'd still appreciate if I could use something that someone else had put the thought into. (Something like "cdb" by Daniel J. Bernstein, but that's an old 32-bit library that's limited to 4 GB files.)

[ Parent | on HN ]

Re:Engineers Shouldn’t Write ETL by ignoramous on Saturday March 19, 2016 @01:30PM (#11319435)

rodb is in-house, non-FOSS tech @ Amazon.

[ Parent | on HN ]

Re:Engineers Shouldn’t Write ETL by scottlocklin on Saturday March 19, 2016 @11:56PM (#11321729)

Thanks, that actually helps, particularly since I sell a competing product (which isn't RO).

[ Parent | on HN ]