Re:GNU Parallel - build and execute command lines from stand...
by Dobbs on Sunday October 17, 2010 @05:29PM
(#1801485)
It seems like 90% of the uses for this can be taken care of with xargs:
[ Parent
| on HN ]
Re:GNU Parallel - build and execute command lines from stand...
by chrisaycock on Sunday October 17, 2010 @05:48PM
(#1801532)
As I understand it, xargs only runs on the local machine; GNU parallel can run on remote machines as well. So parallel is the cluster-friendly version of xargs's -P.
Re:GNU Parallel - build and execute command lines from stand...
by pixelbeat on Monday October 18, 2010 @08:52AM
(#1803235)
Yep. There also is dxargs which looks very useful
http://www.semicomplete.com/blog/geekery/distributed-xargs.h...
Re:GNU Parallel - build and execute command lines from stand...
by tange on Monday October 18, 2010 @05:03PM
(#1805141)
Please read http://www.gnu.org/software/parallel/man.html#differences_be... before selecting dxargs.
Re:GNU Parallel - build and execute command lines from stand...
by oletange on Monday October 18, 2010 @07:35AM
(#1803028)
Please read http://www.gnu.org/software/parallel/man.html#differences_be... before selecting xargs.
Re:GNU Parallel - build and execute command lines from stand...
by CJefferson on Sunday October 17, 2010 @05:48PM
(#1801534)
Don't you need
echo "file1 file2" | xargs -P2 -n1 gzip
?
Re:GNU Parallel - build and execute command lines from stand...
by Goladus on Sunday October 17, 2010 @09:58PM
(#1802046)
Probably, although it doesn't seem to be the focus of xargs.
And the version of xargs that is included with Solaris 10 doesn't have the -P option. In which case, installing gnu parallel is a slightly easier option than installing a different version of xargs.