Re:A lot of complex “scalable” systems can be done with a si...
by numbernine on Sunday December 29, 2019 @06:08PM
(#21909283)
Can you give an example for your last sentence?
[ Parent
| on HN ]
Re:A lot of complex “scalable” systems can be done with a si...
by aspaceman on Sunday December 29, 2019 @11:27PM
(#21910808)
Here's a link: https://scipy-cookbook.readthedocs.io/items/ParallelProgramm... And a quote in italics below.
And, more importantly for us, while numpy is doing an array operation, python also releases the GIL. Thus if you tell one thread to do:
print "%s %s %s %s and %s" %( ("spam",) *3 + ("eggs",) + ("spam",) )
A = B + C
print A
During the print operations and the % formatting operation, no other thread can execute. But during the A = B + C, another thread can run - and if you've written your code in a numpy style, much of the calculation will be done in a few array operations like A = B + C. Thus you can actually get a speedup from using multiple threads.