News for hackers. Stuff that matters.
Re:Go: What We Got Right, What We Got Wrong by qaq on Friday January 05, 2024 @03:43AM (#38877034)
Are there a lot of HPC workloads at Google compared to concurrent/parallel servers?
Re:Go: What We Got Right, What We Got Wrong by kragen on Friday January 05, 2024 @03:51AM (#38877067)
well, now there are. but pagerank was one from the beginning
Re:Go: What We Got Right, What We Got Wrong by dekhn on Friday January 05, 2024 @11:13AM (#38880661)
pagerank was implemented as an iterative mapreduce on classic hardware (and sibyl later adopted this model, using MR as an engine to do what is really an HPC job). Not sure I really consider it HPC, more like high throughput. HOwever, the MR approach worked really well when google was scaling super-fast in the early days; if they'd chosen to solve the problem using MPI and infiniband on expensive SGIs, they probably wouldn't have become the company they are today.
Re:Go: What We Got Right, What We Got Wrong by kragen on Friday January 05, 2024 @01:43PM (#38882844)
agreed about infiniband and sgis, but numerically approximating the principal eigenvalue of a large sparse matrix seems solidly in the core of traditional hpc. btw pagerank predates mr by several years