Re:Google Cloud SQL: your database in the cloud
by Pewpewarrows on Thursday October 06, 2011 @03:46PM
(#3081355)
If this means not having to be locked into App Engine's proprietary database shenanigans for even considering using it to deploy a project, then Google just made it back onto my list of useful PaaS providers.
Re:Google Cloud SQL: your database in the cloud
by jbarham on Thursday October 06, 2011 @11:58PM
(#3082614)
This is misleading.
The reservation fee for a small instance is $227.50 annually (http://aws.amazon.com/ec2/pricing/) but you still pay an hourly rate to run it, albeit a lower rate than for a non-reserved instance. Running a small reserved instance for a year costs $227.50 + ($0.03 x 24 x 365) => $490.3/year or $40.86/month. (This is in the US East region.)
Re:Google Cloud SQL: your database in the cloud
by andypants on Thursday October 06, 2011 @04:29PM
(#3081512)
Nothing has been said on pricing yet. It's free while it's still in developer preview.
Pricing will be revealed later. But even if it ends up being a 'mess' like app engine's pricing situation, it should be much easier to move onto another platform.
Re:Google Cloud SQL: your database in the cloud
by jshen on Friday October 07, 2011 @12:43AM
(#3082704)
I'm convinced they were giving it away at a loss before. Now it's priced the same as similar services which makes sense. Obviously it sucked for the people that caught in it, but the expectations are properly set this time around.
Re:Google Cloud SQL: your database in the cloud
by libria on Thursday October 06, 2011 @04:36PM
(#3081536)
Wow, does that mean we finally get full text search (i.e., LIKE '%%')? Bonus points for OR, JOIN's and multiple inequality filters.
Since they forbid these operations on the datastore, I'm guessing this will either not scale as well or be significantly more expensive. Since the sign up sheet implies you can combine technologies, I suppose you can use a "hybrid" approach and keep denormalized data in the datastore.
Re:Google Cloud SQL: your database in the cloud
by troymc on Friday October 07, 2011 @03:14AM
(#3082999)
The Google App Engine team has been working on a full-text-search service for GAE projects. They gave a demo at Google I/O back in May. Here's a video of their presentation:
Re:Google Cloud SQL: your database in the cloud
by bdonlan on Thursday October 06, 2011 @04:56PM
(#3081617)
Yep, it currently limits you to a 10G database size. Makes sense, though - SQL techniques like LIKE filters or joins really do require all of your data to be in memory with a very high-bandwidth, low latency interconnect - ie, it all has to be in memory on a single box.
This is the reason the datastore forbids these operations - because they're extremely difficult to efficiently implement and still scale indefinitely (without making other, potentially very large sacrifices).
Re:Google Cloud SQL: your database in the cloud
by wulczer on Thursday October 06, 2011 @05:21PM
(#3081719)
What? A join requires all of your data to be in memory? I've sure as hell seen databases that executed queries with joins and the data was not entirely in memory...
Re:Google Cloud SQL: your database in the cloud
by bdonlan on Thursday October 06, 2011 @07:58PM
(#3082103)
Well, sure, it doesn't _require_ it. But the alternative is higher query latency. You have to collect a filtered set of the join column from table A, then ship them over to the servers responsible for table B. If your interconnect has high latency or low bandwidth, this can be painful - particularly if the intermediate set of keys is very large.
Hence why the datastore simply disallows this - yes, it's _possible_ to make joins work on larger datasets. But it's not possible to make _arbitrary_ joins work well on larger datasets.
Re:Google Cloud SQL: your database in the cloud
by dendory on Thursday October 06, 2011 @04:00PM
(#3081405)
As far as I can tell this is just for App Engine stuff, with APIs for Python and Java. They could have opened it up to the web with REST APIs or something similar. Am I wrong?
Re:Google Cloud SQL: your database in the cloud
by njharman on Friday October 07, 2011 @06:31PM
(#3086273)
I care much, much more when I don't manage it cause I've relinquished control to 3rd party.
Because I need to use it. Because I need to build features such as GIS, full text search, transactions. Features who's existence and level of maturity varies wildly across DB platforms.
Re:Google Cloud SQL: your database in the cloud
by ShabbyDoo on Thursday October 06, 2011 @05:14PM
(#3081691)
I didn't see any references to ways by which one might use the special JDBC driver to access one's hosted MySQL data. It would be cute to create an app which proxies JDBC calls so that developers can use TOAD/DBViz/whatever to manipulate remote data. Such a driver might also be useful for one-off schema migration tasks. Did I miss something?
Re:Google Cloud SQL: your database in the cloud
by ShabbyDoo on Thursday October 06, 2011 @05:45PM
(#3081786)
This is huge for allowing corps to migrate apps onto Google's cloud. Many open source web frameworks can be used on GAE (albeit with limitations), but de-SQLing an existing app is probably a non-starter for most corporate dev groups. Even if scale-up is an issue past some threshold, the long tail of most mid-sized companies' in-house apps includes a bunch of semi-legacy ones which don't have very high usage levels. Think about stuff like the environmental regulation compliance database -- important, but probably not used by more than 10's of people.
Re:Google Cloud SQL: your database in the cloud
by tybris on Friday October 07, 2011 @07:52AM
(#3083550)
I don't know of it's so huge for corps. They tend to not mind spending the extra money to get EC2 + RDS in return for reduced lock-in, an environment you can control, and serious SLAs.
Re:Google Cloud SQL: your database in the cloud
by mark_l_watson on Thursday October 06, 2011 @09:20PM
(#3082267)
I hope that the cost ends up being purely research based. I might use this for a few apps that have very limited database requirements. If my database is small and I run relatively few transactions per day then I hope that the cost is minimal. If there is a large minimum charge then that would be a showstopper for my use.
Re:Google Cloud SQL: your database in the cloud
by antoncohen on Thursday October 06, 2011 @05:10PM
(#3081678)
I'm really curious how they implemented this. They say "data is replicated synchronously to multiple data centers." Synchronously MySQL replication over a WAN is pretty impressive. As others have said, this post doesn't mention scalability.
Re:Google Cloud SQL: your database in the cloud
by ww520 on Thursday October 06, 2011 @06:47PM
(#3081954)
There are disk device level replication like DRBD that mirrors disks synchronously across network. It's a generic solution for any disk mirroring. MySQL just sits on top of it.
Google probably got some super fast cross datacenter links to allow fast replication. Still the latency will be worse than local mirroring for synchronously replication.
This addition to app engine makes them more appealing than heroku at this point.
The reservation fee for a small instance is $227.50 annually (http://aws.amazon.com/ec2/pricing/) but you still pay an hourly rate to run it, albeit a lower rate than for a non-reserved instance. Running a small reserved instance for a year costs $227.50 + ($0.03 x 24 x 365) => $490.3/year or $40.86/month. (This is in the US East region.)
Pricing will be revealed later. But even if it ends up being a 'mess' like app engine's pricing situation, it should be much easier to move onto another platform.
Yeah. We know how well that went with GAE.
Since they forbid these operations on the datastore, I'm guessing this will either not scale as well or be significantly more expensive. Since the sign up sheet implies you can combine technologies, I suppose you can use a "hybrid" approach and keep denormalized data in the datastore.
http://www.youtube.com/watch?v=7B7FyU9wW8Y
http://static.googleusercontent.com/external_content/untrust...
I believe this is available in both the Python and Java dev environments.
Additionally, http://code.google.com/appengine/docs/python/prospectivesear... might be of interest.
This is the reason the datastore forbids these operations - because they're extremely difficult to efficiently implement and still scale indefinitely (without making other, potentially very large sacrifices).
Hence why the datastore simply disallows this - yes, it's _possible_ to make joins work on larger datasets. But it's not possible to make _arbitrary_ joins work well on larger datasets.
InnoDB and MyISAM are not good at full text search even on local disk, no reason to make that worse.
Somewhat kinda germane post from Percona: http://www.mysqlperformanceblog.com/2009/09/10/what-to-do-wi...
And I assume still all the other issues; e.g background tasks, processing time.
Django's data access layer is abstracted so it's actually pretty easy to migrate between.
Because I need to use it. Because I need to build features such as GIS, full text search, transactions. Features who's existence and level of maturity varies wildly across DB platforms.
Google probably got some super fast cross datacenter links to allow fast replication. Still the latency will be worse than local mirroring for synchronously replication.
(I don't think that is officially announced but it was mentioned - somewhat accidentally - at a public Google event.)
Fixed
Fixed
Please don't do that.
Fixed