News for hackers. Stuff that matters.
Re:Viewing Sizing Recommendations for Instances by ken47 on Wednesday October 26, 2016 @11:04AM (#12796993)
Google Cloud gets a +1 for this. When a big corp does the right thing for its customers, they take notice.
Re:Viewing Sizing Recommendations for Instances by vasco on Wednesday October 26, 2016 @02:02PM (#12798865)
"Trusted Advisor" on the AWS Console has been doing this for a long time, for several types of under-utilized, not only instances. Not only this but it also notifies you when you're reaching default limits so you can put in a support request for limit increase before you hit them.
Re:Viewing Sizing Recommendations for Instances by user5994461 on Wednesday October 26, 2016 @03:21PM (#12799575)
You gotta pay 10% on top of your bill to have Trusted Advisor. (that's part of the pro support plan).

Last I checked there was no advice on instance size. I've seen one or two, nothing meaningful.

There are lots of advice for reserving instances though, and they are extremely poor. Listening to them would be a good way for us to waste $10k/month :D

Re:Viewing Sizing Recommendations for Instances by sciurus on Wednesday October 26, 2016 @04:45PM (#12800342)
The checks and recommendations aren't very sophisticated, though. E.G. the Low Utilization Amazon EC2 Instances check:

Checks the Amazon Elastic Compute Cloud (Amazon EC2) instances that were running at any time during the last 14 days and alerts you if the daily CPU utilization was 10% or less and network I/O was 5 MB or less on 4 or more days.

Re:Viewing Sizing Recommendations for Instances by kyrra on Wednesday October 26, 2016 @12:23PM (#12797796)
AWS I think has something similar, but I'm not sure it's the same, CloudWatch[0]. Cloudwatch giving alerting and can kill underutilized instances. But this sizing feature from GCP seems to allow for instance resizing rather than just deletion.

As far as why this may benefit google: while a customer will pay the same regardless, that means there are less resources in GCPs overall pool of potential machines that others can use. And to support the overall capacity of all their customers, Google needs more machines to handle them all. I'm guessing Google would rather have most of their machines active, as building out less racks/datacenters is probably better for the bottom-line overall.

[0] https://aws.amazon.com/cloudwatch/details/

Re:Viewing Sizing Recommendations for Instances by snambi on Wednesday October 26, 2016 @12:09PM (#12797643)
Eventually google is going to disrupt the cloud industry, just like how they disrupted the Ad industry by having analytics and providing users with right price and catering to their exact needs.
Re:Viewing Sizing Recommendations for Instances by balls187 on Wednesday October 26, 2016 @12:19PM (#12797761)
That seems very doubtful.

Google started with a dominant search platform. They don't have that luxury with Cloud.

Google used to have a near monopoly on solving hard CS problems, with an army of very very very smart CS grads. They could produce software that no other company could.

These days, many other companies have invested in growing their army of top tier CS devs, and so they are able to make software equally as impressive.

Re:Viewing Sizing Recommendations for Instances by vgt on Wednesday October 26, 2016 @12:40PM (#12798004)
While advantage Google has enjoyed is slimmer, I think it's a fallacy to think that technology has been commoditized.

Slight oversimplification, but Google's had basically S3/GCS and Hadoop since early 2000s, and basically Docker + Kubernetes for the past 10. This translates into real-world edge.

For example, how many big data tools have any one of the 15 characteristics of BigQuery that I described at [0]? Or how many companies have inter-data center networking that gives you a Petabit of bisectional bandwidth, described at [1], or how many cloud providers have live migration, custom VMs, or insane RAM-like local SSD? Or how many PaaS offerings can sustain a behemoth like Snapchat? Or a NoSQL that scales to 56 million qps with just a handful of engineers [2] ??

Edit: To add more color. In days past, Google would release papers (GFS, MapReduce, Bigtable, etc). With Google Cloud Platform we can just externalize these services (with a bit of customer-friendly bits like isolation, pricing, etc). Bigtable, BigQuery (Dremel), PubSub to name a few.

(clearly biased, since I work at Google)

[0]https://medium.com/p/6654841fa2dc

[1]https://cloudplatform.googleblog.com/2015/06/A-Look-Inside-G...

[2]https://cloudplatform.googleblog.com/2016/03/financial-servi...

Re:Viewing Sizing Recommendations for Instances by valarauca1 on Wednesday October 26, 2016 @01:07PM (#12798282)
These are good points. Google does offer services that nobody else has. Some that are very easy to use, and competitively advantageous.

Except... Customer service for cloud platforms is terrible. Not only is there an image problem. The fact that there is almost a blog post about Google Cloud Service screwing over a customer and just flat not communicating happens every 2-3 months.

Re:Viewing Sizing Recommendations for Instances by tscanausa on Wednesday October 26, 2016 @05:41PM (#12800909)
If you have an case ids, where you had terrible service with Google Cloud Platform Support, please send them to me ([email protected]) and I will investigate them.

Best, Terrance

Re:Viewing Sizing Recommendations for Instances by user5994461 on Wednesday October 26, 2016 @03:25PM (#12799616)
Given this description, that doesn't seem any worse than the AWS support. /s
Re:Viewing Sizing Recommendations for Instances by balls187 on Wednesday October 26, 2016 @02:19PM (#12798995)
I was (mostly still am) a big fan of Google BigQuery. Especially since GQL supported some Regex, plus native URL parsing. That is one of the coolest services that Google offers that no other service can match.

However, having used Big Query extensively at my startup, getting external data into it via Google Cloud Storage was a royal pain in my balls.

My broader point, is that Google was able to disrupt the Ad industry because it dominated web search by way of having a large number of exceptionally brilliant engineers. In 2016, that is no longer true--many other big (and small) players have invested in hiring their own equally brilliant engineers.

Re:Viewing Sizing Recommendations for Instances by vgt on Wednesday October 26, 2016 @03:49PM (#12799824)
Sorry to hear. We have completely revamped our ingest mechanism lately. Feel free to ping me with specific problem you had.

From my experience, most issues with loading data stem from just data parsing, or trying to make batch load behave like stream load (we have an api for that too).

And, one of the things I mention in my article, unlike any other database, batch ingest into BigQuery is entirely free, as in not competing with query capacity one bit.

Re:Viewing Sizing Recommendations for Instances by user5994461 on Wednesday October 26, 2016 @03:24PM (#12799606)
> However, having used Big Query extensively at my startup, getting external data into it via Google Cloud Storage was a royal pain in my balls.

More annoying that loading data into S3 for RedShift?

Re:Viewing Sizing Recommendations for Instances by dasmoth on Wednesday October 26, 2016 @11:43AM (#12797392)
This makes me a little nervous. The linked page admits that sometimes there are good reasons for machines to look "underused", but how much luck am I going to have explaining that to a bean counter who thinks he's seen a way to save some money.
Re:Viewing Sizing Recommendations for Instances by Johnny555 on Wednesday October 26, 2016 @03:49PM (#12799830)
If the bean counter is making hardware decisions for the Operations team, then the company deserves what it gets.
Re:Viewing Sizing Recommendations for Instances by snambi on Wednesday October 26, 2016 @12:07PM (#12797618)
Its just a recommendation, Not action.
Re:Viewing Sizing Recommendations for Instances by vgt on Wednesday October 26, 2016 @11:52AM (#12797490)
You can opt out of the service
Re:Viewing Sizing Recommendations for Instances by amelius on Wednesday October 26, 2016 @11:26AM (#12797213)
Why not automatically give me my money back when my VMs are underutilized? :)
Re:Viewing Sizing Recommendations for Instances by mikecb on Wednesday October 26, 2016 @11:32AM (#12797279)
Well, they do do automatic discounts for long-running instances, rather than reservations...
Re:Viewing Sizing Recommendations for Instances by hueving on Wednesday October 26, 2016 @12:52PM (#12798133)
Because the reserved resources were not available for other customers.
Re:Viewing Sizing Recommendations for Instances by amelius on Wednesday October 26, 2016 @02:02PM (#12798859)
That needs fixing then :)
Re:Viewing Sizing Recommendations for Instances by _wmd on Wednesday October 26, 2016 @12:10PM (#12797656)
> During Beta, sizing recommendations are available free of charge. However, Google might charge for this feature in future releases

Heh. "We've established enough foothold to compete with EC2 therefore we're preparing to pull an App Engine

Re:Viewing Sizing Recommendations for Instances by thesandlord on Wednesday October 26, 2016 @05:11PM (#12800599)
This is the standard banner for alpha/beta services. Some become permanently free once they go GA (i.e Cloud Shell) while others become paid (i.e Cloud Vision API)

I work for Google Cloud.

Re:Viewing Sizing Recommendations for Instances by user5994461 on Wednesday October 26, 2016 @03:17PM (#12799542)
Google Cloud 1 - Amazon AWS 0
Re:Viewing Sizing Recommendations for Instances by triplebit on Wednesday October 26, 2016 @01:09PM (#12798304)
Bandwidth pricing for small operations, bandwidth pricing, bandwidth pricing.
Re:Viewing Sizing Recommendations for Instances by markwaldron on Wednesday October 26, 2016 @10:57AM (#12796929)
Does GCE have the ability to automatically resize based on the recommendations?
Re:Viewing Sizing Recommendations for Instances by dvcrn on Wednesday October 26, 2016 @11:05AM (#12797002)
not automatically because the machine needs to get restarted. Can't do that with a production app
Re:Viewing Sizing Recommendations for Instances by homerguy69 on Wednesday October 26, 2016 @11:13AM (#12797079)
If your production services are properly balanced it should be possible. Not sure if the functionality is available.
Re:Viewing Sizing Recommendations for Instances by brianwawok on Wednesday October 26, 2016 @11:48AM (#12797444)
It is not. Not sure this is the right way to do it anyway.