SamJson
Re:Parallel processing with Unix tools
on Sunday September 24, 2017 @06:56AM (#15324251)
Ahh, I see a sysadmin with users! :)
Re:Parallel processing with Unix tools
on Sunday September 24, 2017 @06:55AM (#15324249)
Fun fact from https://www.gnu.org/software/parallel/history.html
> [GNU Parallel] was originally a wrapper that generated a makefile and used make -j to do the parallelization.
Re:Parallel processing with Unix tools
on Sunday September 24, 2017 @06:55AM (#15324246)
The performance is apparently close to xargs (if speed is key, why not just use xargs?). Rust parallel does, however, have some issues that would rule it out for me:
https://www.gnu.org/software/parallel/parallel_alternatives....
Re:Parallel processing with Unix tools
on Sunday September 24, 2017 @03:45AM (#15323777)
I would do:
seq 10 | parallel long_process file{}
Or simply: parallel long_process ::: file*
Re:Parallel processing with Unix tools
on Sunday September 24, 2017 @03:40AM (#15323759)
Someone has compiled a big list of alternatives: https://www.gnu.org/software/parallel/parallel_alternatives....
Most of the tools look unmaintained (last release over a year ago).
Re:Parallel processing with Unix tools
on Sunday September 24, 2017 @03:35AM (#15323745)
You would then not be allowed to call it GNU Parallel due to possible trademark confusion. This also why we have names like CentOS (not RedHat Free) and IceCat (not Firefox Free).
There was a court case in Germany about this (for some CMS tool - IIRC) where a forker used a similar name. The verdict was pretty clear: Forking was OK (copyright law - permission by GPL), but keeping the name was not (trademark law - no permission by GPL).
Re:Parallel processing with Unix tools
on Sunday September 24, 2017 @03:18AM (#15323700)
Author explains background:
https://www.gnu.org/software/parallel/parallel_design.html#C...
Re:Parallel processing with Unix tools
on Sunday September 24, 2017 @03:10AM (#15323679)
Workaround:
(rm file; tac > file) < file