Re:Compute Engine machine types with up to 96 vCPUs and 624G...
by mahdix on Friday October 06, 2017 @07:56AM
(#15416046)
That's interesting. What tools do you use to run your computations in parallel on a cluster? Hadoop?
[ Parent
| on HN ]
Re:Compute Engine machine types with up to 96 vCPUs and 624G...
by malux85 on Friday October 06, 2017 @07:59AM
(#15416060)
For this type of problem - it must be done on a single node. The overhead of network communication would have killed the latency requirement - that's why we need a huge machine like this.
The code was written in C
(We also maintain a Hadoop and Cassandra cluster, and I use Spark for distributed computation - but those are different projects)