News for hackers. Stuff that matters.
Re:Supercomputers will start building a 3D map of the world by jobigoud on Tuesday August 13, 2019 @11:22AM (#20686692)
> calculation that can't be subdivided into parts -- e.g. weather

I'm not sure how weather simulation work but I always wondered why they aren't performed cellular automaton style. Bottom up rather than top-down. At each time step a given cell state is computed based on the state of its neighbors at t-1. This should be parallelizable. I feel it's also how it works in the real world anyway.

Re:Supercomputers will start building a 3D map of the world by petschge on Tuesday August 13, 2019 @12:27PM (#20687325)
That is exactly what weather simulations do. Same most other kinds of hydrodynamic simulations (simulation of gas or fluid flows).

The thing is: you need the state at t-1 of all your neighbors. Then you can do a small timestep to get from t-1 to time t. And then you need the NEW state of your neighbors. That requires a fast interconnect. Which HPC machines have, unlike most clouds or commodity clusters.

In other words, yes it is parallelizable, but not trivially so, because the different grid points are coupled.

Re:Supercomputers will start building a 3D map of the world by kvakkefly on Tuesday August 13, 2019 @04:13PM (#20689745)
I’ve seen that azure has some nodes with infiniband connection (same that is often used in super computers).

I did my PhD in physics simulations (molecular dynamics), and have the same problem there. I tried running these simulations in Google Cloud without any good performance results due to high latency (compared to HPC). I’m no GC expert though, so should be possible to improve what I did.

Re:Supercomputers will start building a 3D map of the world by glaberficken on Tuesday August 13, 2019 @12:56PM (#20687659)
For a simplified explanation of how weather prediction models work check out: NOVA: Decoding the Weather Machine

Available on Netflix for example:

https://www.netflix.com/title/81121177