News for hackers. Stuff that matters.

A comment on Which GPU(s) to Get for Deep Learning. Parent comment

Re:Which GPU(s) to Get for Deep Learning by boulos on Monday May 22, 2017 @10:46PM (#14398454)
While it's easy enough to add GPUs to a Hadoop/Spark cluster (and we did so too via Dataproc [1]) are you just saying that means you assume closer to 100% utilization due to sharing?

If so, that's fine-ish, but then people have to wait (you're either full and people are waiting or you're at less than 100%). My preference is to run for XX minutes per job on-demand (per person). If you have tons of non-overlapping users, you can absolutely aggregate them. But how many do you buy and how quickly do you upgrade to newer hardware?

[1] https://cloud.google.com/dataproc/docs/concepts/gpu-clusters

[ Parent | on HN ]
Re:Which GPU(s) to Get for Deep Learning by agibsonccc on Tuesday May 23, 2017 @12:30AM (#14398804)
I'm talking about on prem clusters where people aren't using cloud. Many of these are just managed by central IT depts (eg: most of enterprise) . We've found folks are perfectly happy to add gpu nodes to an existing cluster managed by yarn or mesos. The incremental upgrade with just another SKU with an existing hardware vendor purchasing/procurement already works with is usually enough.

That being said - it can usually be every 6 months with a renewal of every 2 years or so. Your hardware timelines aren't far off. That being said - I was getting that upgrade cycles don't matter as much.

GPU clusters are enough of a new thing for enterprise yet that the jobs being run aren't even that high spec yet.

My opinion nothing more not claiming this is fact: Google has marched so far ahead of the rest of the world they aren't really paying attention to where current clusters and usage are. It seems a lot of the cloud usage is oriented towards startups and researchers (which isn't a bad thing, most folks in DL are researchers).

For enterprise, they might offload some workloads. There are definitely some workloads where cloud resources (spin up and shut down) make a ton of sense. Cloud servers are overly expensive otherwise.

[ Parent | on HN ]