Re:Citus Data (YC S11) Wants To Make Scalable Data Analytics...
by johnpmayer on Wednesday June 27, 2012 @11:38AM
(#4167514)
This sounds a lot like AsterData Database, which I know has been around for at least a few years. I'm interested to know if you are able to write queries that define explicit parallelism like in the SQL-MapReduce language extension, and also the ability of the query preprocessor for the distributed workload.
[ Parent
| on HN ]
Re:Citus Data (YC S11) Wants To Make Scalable Data Analytics...
by ozgune on Wednesday June 27, 2012 @11:51AM
(#4167573)
Hey, we currently don't have an SQL/MapReduce language extension, but we do have the Map & Reduce execution primitives implemented under the covers (for parallel query processing).
For the distributed query processor, we can efficiently parallelize SQL queries that involve look-ups, complex selections, groupings and orderings, analytic functions, and joins between one large and multiple small tables. We also have a lot more coming; are there any queries that you are particularly interested in?
Re:Citus Data (YC S11) Wants To Make Scalable Data Analytics...
by pella on Wednesday June 27, 2012 @05:02PM
(#4169244)
any information about PostGis compatibility?
Re:Citus Data (YC S11) Wants To Make Scalable Data Analytics...
by ozgune on Wednesday June 27, 2012 @05:31PM
(#4169332)
In all honesty, I'd have to check. The worker nodes in our architecture will be able to use PostGIS indexes just like regular PostgreSQL instances, and the master node should correctly handle (partition) most PostGIS functions. Still, we'd probably need to implement parallelization for the && operator, which shouldn't be that hard.
That said, I don't want to misguide you here before going over PostGIS' documentation more thoroughly. If you could ping us at [email protected], we'll send you a reply once we know for sure.