News for hackers. Stuff that matters.
Re:Google Cloud Platform is the first cloud provider to offe... by zbjornson on Friday February 24, 2017 @11:45AM (#13725242)
I've been benchmarking these against Haswell and Broadwells. Despite being 300 MHz slower, we're getting between 5 and 45% faster benchmarks on linear algebra functions that we run a lot, even without doing much work to tailor to AVX512 instructions yet.

The cache is also a whopping 56 MB.

Re:Google Cloud Platform is the first cloud provider to offe... by boulos on Friday February 24, 2017 @12:12PM (#13725508)
Hi Zach! Are you using MKL at all under the hood (either through numpy, scipy, etc.) or is that just from AVX2 running much better clock-for-clock on Skylake?

Disclosure: I work on Google Cloud.

Re:Google Cloud Platform is the first cloud provider to offe... by alfalfasprout on Friday February 24, 2017 @09:35PM (#13729665)
Not using Google Cloud but Intel just released MKL 2017 Update 2 today that automatically dispatches AVX512 code on supported Xeon CPUs.

Doing a quick comparison between our Haswell servers and Skylake servers we do see a nice little speed bump of ~10-20% on matrix heavy code. The bump is negligible for most other things.

Re:Google Cloud Platform is the first cloud provider to offe... by zbjornson on Friday February 24, 2017 @12:53PM (#13725866)
No MKL, just a mix of AVX2 and a bit of AVX512 written with intrinsics in C++. Working on benchmarking Eigen at the moment, which is also AVX512-optimized.
Re:Google Cloud Platform is the first cloud provider to offe... by eloff on Friday February 24, 2017 @02:51PM (#13727119)
Still limited to a measly 208gb of RAM? That was pretty good back in the day, but now my desktop workstation has 128gb. AWS offers up to 488gb on their latest R4 instances, and 2tb on their X1 instances released a year ago.
Re:Google Cloud Platform is the first cloud provider to offe... by boulos on Friday February 24, 2017 @02:53PM (#13727151)
From the November post [1]:

> You'll be able to use the new processor with Compute Engine’s standard, highmem, highcpu and custom machine types. We also plan to continue to introduce bigger and better VM instance types that offer more vCPUs and RAM for compute- and memory-intensive workloads.

[1] https://cloudplatform.googleblog.com/2016/11/power-up-your-G...

Re:Google Cloud Platform is the first cloud provider to offe... by iamgopal on Friday February 24, 2017 @06:15PM (#13728837)
I use 128 gb too but here we call it SSD
Re:Google Cloud Platform is the first cloud provider to offe... by crypt1d on Friday February 24, 2017 @03:51PM (#13727776)
damn. out of curiosity, what do u use that much ram for?
Re:Google Cloud Platform is the first cloud provider to offe... by jdhawk on Friday February 24, 2017 @04:37PM (#13728152)
Database
Re:Google Cloud Platform is the first cloud provider to offe... by warent on Friday February 24, 2017 @08:20PM (#13729440)
I honestly can't think of any viable purpose for that much RAM unless there's a huge amount of waste happening
Re:Google Cloud Platform is the first cloud provider to offe... by jsmthrowaway on Friday February 24, 2017 @09:17PM (#13729598)
How hard are you thinking? I can think of numerous scenarios where an entire working set being in RAM is useful and occasionally essential, and it is quite common as an optimization in several industries. Finance comes to mind (kdb+ is designed to weaponize tons of RAM), as does high-scale Web operations. This is part of why solid state NVMe devices are compelling, too, to help bridge the gap, but it sounds like not for your purposes.

Even on the less complicated end, some years ago throwing a shitload of page cache at MongoDB was the only way to maintain high write loads, and eventually one reached a point where one had to keep an entire shard in cache. That bottom end threshold is lower than you think. I don't know if that's changed.

Re:Google Cloud Platform is the first cloud provider to offe... by warent on Sunday February 26, 2017 @02:20AM (#13736116)
I could be wrong but it really sounds like you're talking about production. If that's the case then yes, I can respect the RAM requirement and it's almost too obvious to state that it isn't purposeless.

The key here is it's a personal development workstation on which he has these resources. If that's a requirement, I would argue there's something fundamentally wrong with his development processes requiring that much data locally without even a server.

Re:Google Cloud Platform is the first cloud provider to offe... by tiff_seattle on Friday February 24, 2017 @11:34PM (#13730076)
We use multiple machines with 6 TB each at my job, all for use with databases.
Re:Google Cloud Platform is the first cloud provider to offe... by jdhawk on Friday February 24, 2017 @04:38PM (#13728165)
No - I believe these will be up to 64core & 416GB
Re:Google Cloud Platform is the first cloud provider to offe... by boulos on Friday February 24, 2017 @06:03PM (#13728758)
Nope. Bigger :).
Re:Google Cloud Platform is the first cloud provider to offe... by jdhawk on Saturday March 04, 2017 @03:40PM (#13792831)
Interesting, are you guys decoupling the 1.6GB/RAM per core requirement?

I'd love to spin up a 32x512GB for a DB Server.