Re:Why Learn Compilers
by seanmcdirmid on Monday May 29, 2023 @10:42PM
(#36120593)
Deterministic parallelism has a non-trivial cost that can negate the perf you were hoping to gain by using multiple cores (or even GPU cores) in parallel.
Having said that, most people are not careful, and most languages make it very hard to be careful.
The keyword is 'deterministic parallelism', if you want to look into the research. See eg https://www.well-typed.com/blog/2012/12/deterministic-parall...