News for hackers. Stuff that matters.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by aneutron on Friday October 06, 2017 @07:25AM (#15415884)
I honestly wonder why did Google cite "SAP HANA" as the _reference_ workload for such setups. I never heard of that product. Noobie asking here, is it the _reference_ workload for such setups ? And are there more demanding workloads ?
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by noelwelsh on Friday October 06, 2017 @07:36AM (#15415945)
If you can afford SAP you can afford these instances. I think it's a form of signalling to enterprises that the cloud offerings are suitable for them.

HPC people are much technical and less conservative, in general, and can sort themselves out.

Re:Compute Engine machine types with up to 96 vCPUs and 624G... by willyyr on Friday October 06, 2017 @07:31AM (#15415915)
I guess because SAP HANA is an in memory database which requires, well, a lot of memory. Other providers use HANA as a reference as well.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by _pmf_ on Friday October 06, 2017 @08:26AM (#15416236)
I assume that it's one of very few in-memory databases that are a) in actual production use and b) not already trivially distributed/distributable

I.e. just like Azul Systems' system, it's for running bad enterprise applications that you cannot scale with regular means.

Re:Compute Engine machine types with up to 96 vCPUs and 624G... by codeduck on Friday October 06, 2017 @07:32AM (#15415922)
AWS do the same: https://aws.amazon.com/ec2/instance-types/x1/

Interestingly, AWS have X1 and X1E-class EC2 offerings, two of which are significantly larger than this new Google offering.

Re:Compute Engine machine types with up to 96 vCPUs and 624G... by Jdam on Friday October 06, 2017 @07:33AM (#15415929)
But only Haswell, where GCP offers Skylake
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by dom0 on Friday October 06, 2017 @01:36PM (#15418628)
So -80 % memory for 0-5 % more compute throughput?
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by p0rkbelly on Friday October 06, 2017 @12:50PM (#15418243)
...but curious to see the performance gain on SAP (or similar) workloads with a new CPU architecture. RAM is the bottleneck typically.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by boulos on Friday October 06, 2017 @02:46PM (#15419290)
I think their latest instances were 4 socket Broadwell.

Disclosure: I work on Google Cloud.

Re:Compute Engine machine types with up to 96 vCPUs and 624G... by bpicolo on Friday October 06, 2017 @08:32AM (#15416271)
AWS used it as their reference workload for similarly sized boxes too. SAP HANA is a huge deal in certain sectors. I assume there were plenty of clients they couldn't land without support for it.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by totalrobe on Friday October 06, 2017 @07:41AM (#15415969)
SAP HANA is an in-memory database. It's probably one of the more recognizable workloads to require significant amounts of ram.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by Jdam on Friday October 06, 2017 @07:34AM (#15415934)
Maybe because SAP HANA requires vertical scaling. For horizontal scaling, I don't see a point in using such big instances.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by manigandham on Friday October 06, 2017 @07:46AM (#15415993)
On Google, the pricing is by cpu/ram so 1x 96 vcpu instance = 12x 8 vcpu instances in cost. Often easier to just run less of more powerful instances.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by brianwawok on Friday October 06, 2017 @09:38AM (#15416665)
Unless you are single process bound, say mysql or postgres instance.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by manigandham on Friday October 06, 2017 @10:15AM (#15416920)
Sure, legacy software is still catching up to multiple cores. Postgres is much better now or you can use SQL Server instead. None of them are native multi-master anyway so scale up is still better than scale out unless you only need reads.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by brianwawok on Friday October 06, 2017 @11:21AM (#15417467)
I am not sure it is correct to call Postgres or MySql "legacy software"

To me, legacy software would be something like using Novel PeopleManager 2002 or WordPerfect 7.

Postgres 10.0 is < a week old, and is a perfectly fine path to go for a brand new application. You are fooling yourself if you think you should just throw every new application in MongoDB or Cassandra because they are "web scale".

If you are using "Legacy Software" to mean "software that has existed for a long time", then I guess sure. But there are many pieces of software that are very new, and could benefit from a single instance with a lot of cores.

The most common use of "Legacy Software" is "Old crusty stuff which needs to be replaced", which is NOT at all the case for MySql or Postgres.

Re:Compute Engine machine types with up to 96 vCPUs and 624G... by manigandham on Friday October 06, 2017 @11:38AM (#15417621)
It seems you've misunderstood my comments. Perhaps read them again? I'm saying that it's easier to have fewer more powerful servers than many more smaller ones, but even then some software designed for single-node operations still has problems utilizing all the cores (like postgres until recently). I never mentioned mongodb or cassandra.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by ddorian43 on Friday October 06, 2017 @01:48PM (#15418744)
And that was only for single query to use multiple cores (olap). For oltp multi-core is no problem.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by imtringued on Friday October 06, 2017 @11:44AM (#15417673)
If you don't care about inter node transactions you can use citus for postgresql scaling.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by ddorian43 on Friday October 06, 2017 @01:49PM (#15418759)
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by manigandham on Friday October 06, 2017 @03:54PM (#15419884)
Yes, Citus is good stuff. We use MemSQL though as it's a better fit for our (data warehouse) needs. There's also TimescaleDB, PipelineDB, CockroachDB, and more, lots of interesting options today for distributed "newsql" databases.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by mrich on Friday October 06, 2017 @09:26AM (#15416594)
You can scale HANA vertically and horizontally. Vertical makes sense for ERP workloads where you want low latency (avoiding communication). The ERP workloads of most companies can fit in RAM easily nowadays. Horizontal scaling is best for data warehousing/analytical workloads, which tend to be more CPU bound due to lots of calculations.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by tgtweak on Friday October 06, 2017 @11:08AM (#15417347)
Horizonal scaling costs more in base licensing, not to mention whatever 3rd party stuff you're running in your Hana. Enough to encourage scaling up as far as you can before scaling out.
Re:Compute Engine machine types with up to 96 vCPUs and 624G... by Jdam on Friday October 06, 2017 @12:35PM (#15418120)
> You can scale HANA vertically and horizontally

Nah, with scaling, I‘m more referring to approaches of eg Cassandra instead of „add another read replica“.

Re:Compute Engine machine types with up to 96 vCPUs and 624G... by mrich on Monday October 16, 2017 @12:08AM (#15480762)
I wasn't talking about replicas either. HANA can distribute data over many clusters.

https://blogs.saphana.com/2014/12/10/sap-hana-scale-scale-ha...

HANA's roots lie in BWA (SAP BW accelerator), whose main game was distributing large amounts of data across commodity clusters.

Re:Compute Engine machine types with up to 96 vCPUs and 624G... by dwyerm on Friday October 06, 2017 @01:13PM (#15418415)
I would honestly like to hear of another reference workload for machines of this type. I can't find very many uses other than databases for that much memory.

I think you can store every single uncompressed frame of a bluray movie in memory of an AWS X1... but even then, so what?