News for hackers. Stuff that matters.
Re:AMD Now Has More Compute on the Top500 Than Nvidia by llm_trw on Tuesday November 19, 2024 @12:30AM (#42180326)
The same way that you're responsible for distributing your single threaded code between cores on your desktop.
Re:AMD Now Has More Compute on the Top500 Than Nvidia by davrosthedalek on Tuesday November 19, 2024 @07:29AM (#42182694)
No. Threads run typically in the same address space. HPC processes on different nodes typically do not.
Re:AMD Now Has More Compute on the Top500 Than Nvidia by llm_trw on Tuesday November 19, 2024 @09:00AM (#42183490)
Define address space.

Cache is not shared between cores.

HPCs just have more levels of cache.

Lest you ignore the fact that infiniband is pretty much on par with top of the line ddr speeds for the matching generation.

Re:AMD Now Has More Compute on the Top500 Than Nvidia by moralestapia on Tuesday November 19, 2024 @12:08PM (#42185697)
>Lest you ignore the fact that infiniband is pretty much on par with top of the line ddr speeds for the matching generation.

You can't go faster than the speed of light (yet) and traveling a few micrometers will always be much faster than traversing a room (plus routing and switching).

Many HPC tasks nowadays are memory-bound rather than CPU-bound, memory-latency-and-throughput-bound to be more precise. An actual supercomputer would be something like the Cerebras chip, a lot of the performance increase you get is due to having everything on-chip at a given time.

Re:AMD Now Has More Compute on the Top500 Than Nvidia by formerly_proven on Tuesday November 19, 2024 @11:29AM (#42185261)
There are four sentences in your comment.

None of them logically relate to another.

One is a question.

And the rest are wrong.

Re:AMD Now Has More Compute on the Top500 Than Nvidia by davrosthedalek on Tuesday November 19, 2024 @09:13AM (#42183627)
Really? How about: "This pointer is valid, has the same numeric value (address) and points to the same data in all threads". The point is not the latency nor bandwidth. The point is the programming/memory model. Infiniband maybe makes multiprocessing across nodes as fast as multiprocessing on a single node. But it's not multithreading.
Re:AMD Now Has More Compute on the Top500 Than Nvidia by imtringued on Tuesday November 19, 2024 @09:49AM (#42184007)
>Cache is not shared between cores.

I feel sorry for you if you believe this. It's not true physically nor is it true on the level of the cache coherence protocol nor is it true from the perspective of the operating system.

Re:AMD Now Has More Compute on the Top500 Than Nvidia by almostgotcaught on Tuesday November 19, 2024 @08:23AM (#42183140)
Tell me you've never run a distributed workload without telling me. You realize if what you were saying were true, HPC would be trivial. In fact it takes a whole lot of PhDs to manage the added complexity because it's not just a "single computer".
Re:AMD Now Has More Compute on the Top500 Than Nvidia by llm_trw on Tuesday November 19, 2024 @08:49AM (#42183388)
If you think parallelizing single threaded code is trivial ... well there's nothing else to say really.
Re:AMD Now Has More Compute on the Top500 Than Nvidia by almostgotcaught on Tuesday November 19, 2024 @08:59AM (#42183483)
Is there like a training program available for learning how to be this obstinate? I would love to attend so that I can win fights with my wife.
Re:AMD Now Has More Compute on the Top500 Than Nvidia by davrosthedalek on Tuesday November 19, 2024 @03:39PM (#42187852)
Maybe llm_trw is your wife?