News for hackers. Stuff that matters.
Re:Google Cloud SQL: your database in the cloud by bdonlan on Thursday October 06, 2011 @04:56PM (#3081617)
Yep, it currently limits you to a 10G database size. Makes sense, though - SQL techniques like LIKE filters or joins really do require all of your data to be in memory with a very high-bandwidth, low latency interconnect - ie, it all has to be in memory on a single box.

This is the reason the datastore forbids these operations - because they're extremely difficult to efficiently implement and still scale indefinitely (without making other, potentially very large sacrifices).

Re:Google Cloud SQL: your database in the cloud by wulczer on Thursday October 06, 2011 @05:21PM (#3081719)
What? A join requires all of your data to be in memory? I've sure as hell seen databases that executed queries with joins and the data was not entirely in memory...
Re:Google Cloud SQL: your database in the cloud by bdonlan on Thursday October 06, 2011 @07:58PM (#3082103)
Well, sure, it doesn't _require_ it. But the alternative is higher query latency. You have to collect a filtered set of the join column from table A, then ship them over to the servers responsible for table B. If your interconnect has high latency or low bandwidth, this can be painful - particularly if the intermediate set of keys is very large.

Hence why the datastore simply disallows this - yes, it's _possible_ to make joins work on larger datasets. But it's not possible to make _arbitrary_ joins work well on larger datasets.

Re:Google Cloud SQL: your database in the cloud by AndrewDucker on Friday October 07, 2011 @11:49AM (#3084471)
Joins on indexed columns don't require anything apart from the index to be in memory in order to do the filtering.