Re:Presto: Interacting with petabytes of data at Facebook
by rpedela on Wednesday November 06, 2013 @05:43PM
(#6686059)
Makes sense. I was thinking for the case where you have data in multiple databases/servers and want to do aggregation or joins without first doing some ETL step to bring the data into another format. Unless there is something Presto can do that a relational database can't, I would assume you just use normal SQL if you have a single database.
Re:Presto: Interacting with petabytes of data at Facebook
by CurtMonash on Thursday November 07, 2013 @02:18AM
(#6688086)
If you did that, wouldn't you just be re-inventing DATAllegro or early versions of Greenplum or early versions of Aster? I.e., better than nothing, but still far short of a modern analytic relational DBMS?
Re:Presto: Interacting with petabytes of data at Facebook
by rpedela on Thursday November 07, 2013 @09:56AM
(#6689617)
Are those things open-source?
Re:Presto: Interacting with petabytes of data at Facebook
by CurtMonash on Friday November 08, 2013 @10:30AM
(#6696597)
Actually, there was an early version of Greenplum that was open source. Nobody seemed to care much.
That said, earlier this year, during a hackathon, we build a prototype connector that could split a query and push down the relevant parts to a distributed database that supports simple aggregations. It would be more work to clean this up and integrate, so if a lot of people are interested in this we can prioritize that.