News for hackers. Stuff that matters.
Re:Google Cloud SQL: your database in the cloud by Pewpewarrows on Thursday October 06, 2011 @03:46PM (#3081355)
If this means not having to be locked into App Engine's proprietary database shenanigans for even considering using it to deploy a project, then Google just made it back onto my list of useful PaaS providers.
Re:Google Cloud SQL: your database in the cloud by MaurizioPz on Monday October 10, 2011 @03:51AM (#3092697)
Using a database wrapper like http://www.sienaproject.com/ you wouldn't be locked.
Re:Google Cloud SQL: your database in the cloud by hartror on Thursday October 06, 2011 @10:47PM (#3082457)
My feelings exactly. It was always a blocker before, being locked to a provider is murder.
Re:Google Cloud SQL: your database in the cloud by jshen on Thursday October 06, 2011 @04:13PM (#3081454)
My biggest complaint with Heroku is that they don't have a database offering between $15/month and $200/month.

This addition to app engine makes them more appealing than heroku at this point.

Re:Google Cloud SQL: your database in the cloud by matan_a on Thursday October 06, 2011 @04:42PM (#3081560)
True, but since they sit on AWS, you can just use Amazon RDS with your Heroku app on a small instance and be just fine.
Re:Google Cloud SQL: your database in the cloud by jshen on Thursday October 06, 2011 @04:48PM (#3081584)
Which starts around $80/month. There is still a hole there.
Re:Google Cloud SQL: your database in the cloud by riffraff on Thursday October 06, 2011 @05:05PM (#3081661)
but a reserved instance for a year is $227, which is not far from $15 a month.
Re:Google Cloud SQL: your database in the cloud by jbarham on Thursday October 06, 2011 @11:58PM (#3082614)
This is misleading.

The reservation fee for a small instance is $227.50 annually (http://aws.amazon.com/ec2/pricing/) but you still pay an hourly rate to run it, albeit a lower rate than for a non-reserved instance. Running a small reserved instance for a year costs $227.50 + ($0.03 x 24 x 365) => $490.3/year or $40.86/month. (This is in the US East region.)

Re:Google Cloud SQL: your database in the cloud by riffraff on Friday October 07, 2011 @03:29AM (#3083027)
oops, of course, sorry for this
Re:Google Cloud SQL: your database in the cloud by jshen on Thursday October 06, 2011 @05:39PM (#3081768)
Thanks, I missed the reserved instances somehow.
Re:Google Cloud SQL: your database in the cloud by dangrossman on Friday October 07, 2011 @12:47AM (#3082710)
The $227 buys you a lower hourly rate, it doesn't buy you use of an instance for a year.
Re:Google Cloud SQL: your database in the cloud by andypants on Thursday October 06, 2011 @04:29PM (#3081512)
Nothing has been said on pricing yet. It's free while it's still in developer preview.

Pricing will be revealed later. But even if it ends up being a 'mess' like app engine's pricing situation, it should be much easier to move onto another platform.

Re:Google Cloud SQL: your database in the cloud by buff-a on Thursday October 06, 2011 @11:16PM (#3082514)
Cloud SQL is available free of charge for now, and we will publish pricing at least 30 days before charging for it.

Yeah. We know how well that went with GAE.

Re:Google Cloud SQL: your database in the cloud by jshen on Friday October 07, 2011 @12:43AM (#3082704)
I'm convinced they were giving it away at a loss before. Now it's priced the same as similar services which makes sense. Obviously it sucked for the people that caught in it, but the expectations are properly set this time around.
Re:Google Cloud SQL: your database in the cloud by riffraff on Thursday October 06, 2011 @05:02PM (#3081648)
honestly, after what happened last time, this

     Cloud SQL is available free of charge for now, and we will publish pricing at least 30 days before charging for it. 
Seems a lot less nice.
Re:Google Cloud SQL: your database in the cloud by cowkingdeluxe on Thursday October 06, 2011 @07:28PM (#3082046)
And the fact that Google likes to shut down services.
Re:Google Cloud SQL: your database in the cloud by andypants on Thursday October 06, 2011 @06:38PM (#3081934)
Agreed, but the difference is that it should be far easier to migrate away if anything turns out badly for you.
Re:Google Cloud SQL: your database in the cloud by libria on Thursday October 06, 2011 @04:36PM (#3081536)
Wow, does that mean we finally get full text search (i.e., LIKE '%%')? Bonus points for OR, JOIN's and multiple inequality filters.

Since they forbid these operations on the datastore, I'm guessing this will either not scale as well or be significantly more expensive. Since the sign up sheet implies you can combine technologies, I suppose you can use a "hybrid" approach and keep denormalized data in the datastore.

Re:Google Cloud SQL: your database in the cloud by troymc on Friday October 07, 2011 @03:14AM (#3082999)
The Google App Engine team has been working on a full-text-search service for GAE projects. They gave a demo at Google I/O back in May. Here's a video of their presentation:

http://www.youtube.com/watch?v=7B7FyU9wW8Y

Re:Google Cloud SQL: your database in the cloud by nl on Friday October 07, 2011 @07:17AM (#3083455)
Re:Google Cloud SQL: your database in the cloud by bdonlan on Thursday October 06, 2011 @04:56PM (#3081617)
Yep, it currently limits you to a 10G database size. Makes sense, though - SQL techniques like LIKE filters or joins really do require all of your data to be in memory with a very high-bandwidth, low latency interconnect - ie, it all has to be in memory on a single box.

This is the reason the datastore forbids these operations - because they're extremely difficult to efficiently implement and still scale indefinitely (without making other, potentially very large sacrifices).

Re:Google Cloud SQL: your database in the cloud by wulczer on Thursday October 06, 2011 @05:21PM (#3081719)
What? A join requires all of your data to be in memory? I've sure as hell seen databases that executed queries with joins and the data was not entirely in memory...
Re:Google Cloud SQL: your database in the cloud by bdonlan on Thursday October 06, 2011 @07:58PM (#3082103)
Well, sure, it doesn't _require_ it. But the alternative is higher query latency. You have to collect a filtered set of the join column from table A, then ship them over to the servers responsible for table B. If your interconnect has high latency or low bandwidth, this can be painful - particularly if the intermediate set of keys is very large.

Hence why the datastore simply disallows this - yes, it's _possible_ to make joins work on larger datasets. But it's not possible to make _arbitrary_ joins work well on larger datasets.

Re:Google Cloud SQL: your database in the cloud by AndrewDucker on Friday October 07, 2011 @11:49AM (#3084471)
Joins on indexed columns don't require anything apart from the index to be in memory in order to do the filtering.
Re:Google Cloud SQL: your database in the cloud by mscarborough on Thursday October 06, 2011 @09:40PM (#3082315)
Or preferably, Sphinx support. From the announcement I can't see that you can't do it, but not that you can.

InnoDB and MyISAM are not good at full text search even on local disk, no reason to make that worse.

Somewhat kinda germane post from Percona: http://www.mysqlperformanceblog.com/2009/09/10/what-to-do-wi...

Re:Google Cloud SQL: your database in the cloud by dendory on Thursday October 06, 2011 @04:00PM (#3081405)
As far as I can tell this is just for App Engine stuff, with APIs for Python and Java. They could have opened it up to the web with REST APIs or something similar. Am I wrong?
Re:Google Cloud SQL: your database in the cloud by slig on Thursday October 06, 2011 @04:03PM (#3081412)
Wouldn't the latency be a huge issue?
Re:Google Cloud SQL: your database in the cloud by dendory on Thursday October 06, 2011 @06:20PM (#3081885)
Depends on the use. Plenty of systems have a local memory cache and queries database only for large chunks of data.
Re:Google Cloud SQL: your database in the cloud by andypants on Thursday October 06, 2011 @04:30PM (#3081514)
Only as much of an issue as with other database hosts? (ie. not much of an issue at all)
Re:Google Cloud SQL: your database in the cloud by alexandros on Friday October 07, 2011 @03:10AM (#3082985)
What stops you from writing a GAE app to do just that? There's papers out there on how to map SQL to REST APIs, I've written a few myself.
Re:Google Cloud SQL: your database in the cloud by defrex on Thursday October 06, 2011 @04:24PM (#3081489)
This should make App Engine a fantastic place to host Django projects.
Re:Google Cloud SQL: your database in the cloud by njharman on Thursday October 06, 2011 @05:01PM (#3081642)
Except every Django project I've done last several years is PostgreSQL not MySQL.

And I assume still all the other issues; e.g background tasks, processing time.

Re:Google Cloud SQL: your database in the cloud by chrismsnz on Thursday October 06, 2011 @05:49PM (#3081797)
Who cares what DB it is when you don't have to manage it?

Django's data access layer is abstracted so it's actually pretty easy to migrate between.

Re:Google Cloud SQL: your database in the cloud by njharman on Friday October 07, 2011 @06:31PM (#3086273)
I care much, much more when I don't manage it cause I've relinquished control to 3rd party.

Because I need to use it. Because I need to build features such as GIS, full text search, transactions. Features who's existence and level of maturity varies wildly across DB platforms.

Re:Google Cloud SQL: your database in the cloud by ShabbyDoo on Thursday October 06, 2011 @05:14PM (#3081691)
I didn't see any references to ways by which one might use the special JDBC driver to access one's hosted MySQL data. It would be cute to create an app which proxies JDBC calls so that developers can use TOAD/DBViz/whatever to manipulate remote data. Such a driver might also be useful for one-off schema migration tasks. Did I miss something?
Re:Google Cloud SQL: your database in the cloud by brown9-2 on Thursday October 06, 2011 @05:39PM (#3081770)
It seems pretty doubtful you would be able to use this to access the hosted data remotely.
Re:Google Cloud SQL: your database in the cloud by ShabbyDoo on Thursday October 06, 2011 @05:45PM (#3081786)
This is huge for allowing corps to migrate apps onto Google's cloud. Many open source web frameworks can be used on GAE (albeit with limitations), but de-SQLing an existing app is probably a non-starter for most corporate dev groups. Even if scale-up is an issue past some threshold, the long tail of most mid-sized companies' in-house apps includes a bunch of semi-legacy ones which don't have very high usage levels. Think about stuff like the environmental regulation compliance database -- important, but probably not used by more than 10's of people.
Re:Google Cloud SQL: your database in the cloud by tybris on Friday October 07, 2011 @07:52AM (#3083550)
I don't know of it's so huge for corps. They tend to not mind spending the extra money to get EC2 + RDS in return for reduced lock-in, an environment you can control, and serious SLAs.
Re:Google Cloud SQL: your database in the cloud by ww520 on Thursday October 06, 2011 @04:16PM (#3081462)
The buzz word scalability is not in the blog. I assume it's just a shared MySQL server like the shared hosting vendors offered.
Re:Google Cloud SQL: your database in the cloud by mark_l_watson on Thursday October 06, 2011 @09:20PM (#3082267)
I hope that the cost ends up being purely research based. I might use this for a few apps that have very limited database requirements. If my database is small and I run relatively few transactions per day then I hope that the cost is minimal. If there is a large minimum charge then that would be a showstopper for my use.
Re:Google Cloud SQL: your database in the cloud by antoncohen on Thursday October 06, 2011 @05:10PM (#3081678)
I'm really curious how they implemented this. They say "data is replicated synchronously to multiple data centers." Synchronously MySQL replication over a WAN is pretty impressive. As others have said, this post doesn't mention scalability.
Re:Google Cloud SQL: your database in the cloud by ww520 on Thursday October 06, 2011 @06:47PM (#3081954)
There are disk device level replication like DRBD that mirrors disks synchronously across network. It's a generic solution for any disk mirroring. MySQL just sits on top of it.

Google probably got some super fast cross datacenter links to allow fast replication. Still the latency will be worse than local mirroring for synchronously replication.

Re:Google Cloud SQL: your database in the cloud by nl on Friday October 07, 2011 @07:22AM (#3083466)
I believe they (Google) has a MySQL backend implemented on BigTable.

(I don't think that is officially announced but it was mentioned - somewhat accidentally - at a public Google event.)

Re:Google Cloud SQL: your database in the cloud by jsr on Thursday October 06, 2011 @04:44PM (#3081570)
How scalable is this? Are there capacity or transaction rate limits on Cloud SQL?
Re:Google Cloud SQL: your database in the cloud by dsl on Thursday October 06, 2011 @04:57PM (#3081624)
You get MySQL instances, just like Amazon RDS. All the limitations of MySQL in the real world still apply.
Re:Google Cloud SQL: your database in the cloud by gabi38 on Friday October 07, 2011 @07:55AM (#3083555)
Is there any area that google don't stick their nose in? Now they are also in the DB business??
Re:Google Cloud SQL: your database in the cloud by rhizome on Thursday October 06, 2011 @04:51PM (#3081600)
Google: bringing the reliability of the Internet to relational databases!
Re:Google Cloud SQL: your database in the cloud by zobzu on Thursday October 06, 2011 @04:08PM (#3081431)
Gotta love the ways you have to literally just give away your data to Google.
Re:Google Cloud SQL: your database in the cloud by thematt on Thursday October 06, 2011 @04:15PM (#3081457)
The other cloud providers have similar offerings. It has nothing to do with Google.
Re:Google Cloud SQL: your database in the cloud by zobzu on Thursday October 06, 2011 @05:14PM (#3081689)
same issue. most of the time its google tho. their business is based on it and theyre good at it.
Re:Google Cloud SQL: your database in the cloud by dannyr on Thursday October 06, 2011 @05:40PM (#3081772)
> Gotta love the ways you can CHOOSE to give away your data to any third-party service provider.

Fixed

Re:Google Cloud SQL: your database in the cloud by Pewpewarrows on Thursday October 06, 2011 @04:17PM (#3081465)
> Gotta love the ways you can optionally give away your data to any third-party service provider.

Fixed

Re:Google Cloud SQL: your database in the cloud by jamesbritt on Thursday October 06, 2011 @05:02PM (#3081649)
Fixed

Please don't do that.

Re:Google Cloud SQL: your database in the cloud by zobzu on Thursday October 06, 2011 @05:17PM (#3081702)
ways with an s. its called english :-) unfortunately many just misread it because the comment emits criticism.
Re:Google Cloud SQL: your database in the cloud by streptomycin on Thursday October 06, 2011 @04:31PM (#3081517)
> Gotta love the ways you can elect to give away your data to any third-party service provider.

Fixed