Re:Airbnb open-sources Caravel: data exploration and visuali...
by phunge on Thursday March 31, 2016 @03:50PM
(#11400085)
They mention that it was originally paired with Druid. The data volume that Druid excels at (and that AirBnB must have) is orders of magnitude larger than what Tableau&Looker do well with. It's probably just built for bigger-than-SQL OLAP usecases.
[ Parent
| on HN ]
Re:Airbnb open-sources Caravel: data exploration and visuali...
by dwmintz on Thursday March 31, 2016 @04:26PM
(#11400328)
It's worth distinguishing between the tools that leave the data in your data warehouse (Caravel, Periscope, Mode, Looker (where I work)), and those that have their own data stores (Good Data, Qlikview, etc.) Tableau can connect directly to your datastore, but it's happier if it can operate on data that's stored locally in-memory.
Anyway, the ones where bring your own database can scale as far as the database can bring you.
Re:Airbnb open-sources Caravel: data exploration and visuali...
by caravel on Thursday March 31, 2016 @05:44PM
(#11400790)
Note that Tableau doesn't play well with Presto which Airbnb uses extensively. No possibility of using the "live mode"
Re:Airbnb open-sources Caravel: data exploration and visuali...
by dwmintz on Friday April 01, 2016 @10:04AM
(#11404808)
Not arguing that Airbnb should use Looker, but fwiw, Looker (where I work) does in fact connect to Presto fine.
Re:Airbnb open-sources Caravel: data exploration and visuali...
by jsiegz on Thursday March 31, 2016 @04:12PM
(#11400249)
Looker scales with plenty of data for us at Snapchat, it's more about the underlying database than the BI tool.
Re:Airbnb open-sources Caravel: data exploration and visuali...
by MechanicalTwerk on Thursday March 31, 2016 @07:14PM
(#11401345)
Note that this user used to work at Looker.
Re:Airbnb open-sources Caravel: data exploration and visuali...
by jsiegz on Thursday March 31, 2016 @08:31PM
(#11401706)
yep i did.
Re:Airbnb open-sources Caravel: data exploration and visuali...
by adrr on Thursday March 31, 2016 @05:38PM
(#11400748)
Looker performance comes from the underlying storage of data. You can store massive amounts of data on say a Red Shift cluster and still be performant. Most visualization tools that i know are directly tied to storage tier in terms of performance.
Re:Airbnb open-sources Caravel: data exploration and visuali...
by caravel on Thursday March 31, 2016 @05:45PM
(#11400802)
I don't think Looker supports Druid.
Re:Airbnb open-sources Caravel: data exploration and visuali...
by dwmintz on Friday April 01, 2016 @10:03AM
(#11404803)
That's correct. We (I work at Looker) are written to leverage the analytical capabilities of SQL. So we support all kinds of SQL implementations, from totally standard (PG, MySQL, MS) to MPPs (Redshift, BigQuery) to SQL-on-Hadoop (Hive, Impala, Presto, Spark).
But the JDBC -> Druid connectors that exist look pretty janky. So if someone builds a stable connector, I suspect we'd support it. But for the moment, no Druid.