News for hackers. Stuff that matters.
Re:GNU Parallel – The command line power tool by rcthompson on Tuesday August 13, 2013 @11:53PM (#6209854)
i use GNU parallel exclusively in place of xargs simply because it has --dry-run.
Re:GNU Parallel – The command line power tool by _ZeD_ on Wednesday August 14, 2013 @12:08AM (#6209893)
wouldn't an "echo" just do the same?

    $ mkdir a
    $ cd a
    $ touch b c d e
    $ find -type f | xargs echo rm
    rm ./b ./d ./e ./c
    $ ls
    b  c  d  e
    $ find -type f | xargs rm
    $ ls
    $
Re:GNU Parallel – The command line power tool by jasomill on Wednesday August 14, 2013 @03:21AM (#6210271)
One advantage of "parallel --dry-run" over "xargs echo" is that the former quotes its output:

    $ touch 'Ham
    Jam
    Spam'
    $ touch 'J.R. "Bob" Dobbs'
    $ find . -type f -print0 | parallel -n1 -0 --dry-run echo
    echo ./Ham'
    'Jam'
    'Spam
    echo ./J.R.\ \"Bob\"\ Dobbs
    $ find . -type f -print0 | xargs -n1 -0 echo echo
    echo ./Ham
    Jam
    Spam
    echo ./J.R. "Bob" Dobbs
For my own "dry runs", though, I've always preferred passing the command line to

    #include <stdio.h>
    
    int main(int argc, char* argv[]) {
        char** argp;
        int i;
        printf("argc = %d\n", argc);
        for (i = 0, argp = argv; *argp != 0; ++argp, ++i) {
            printf("argv[%d] = %s\n", i, *argp);
        }
        return 0;
    }
to remove all reasonable doubt.
Re:GNU Parallel – The command line power tool by peterwwillis on Wednesday August 14, 2013 @10:19AM (#6211623)
Why does the parallel example look weird? It put the single quotes in all the wrong places, and completely around Jam. It should have printed

  echo './Ham
  Jam
  Spam'
but your output looks different. As an example of how it should look, try this:

  $ find . -type f -print0 | xargs -n1 -0 perl -e'print "\"$_\" " for (@ARGV)'
  "./Ham
  Jam
  Spam"
Re:GNU Parallel – The command line power tool by davvolun on Wednesday August 14, 2013 @02:59PM (#6213509)
Having never used parallel, I still believe parallel was correct.

./Ham' 'Jam' 'Spam

would be identical to ./Ham\nJam\nSpam (if \n were the correct translation to the newline in this case) or './Ham Jam Spam'

This would be identical to what you wrote, but only punts to quotes when it doesn't have a canonical method of representing the character otherwise. The fact that you don't need to explicitly concatenate two strings in the shell may be what's throwing you off?

Interestingly enough, 'Ham\n\nJam\nSpam' becomes

./Ham' '' 'Jam' 'Spam

So parallel is just literally outputting all newlines using quotes. I believe this would be identical, if you analyzed it and saw that two newlines are next to each other:

./Ham'

'Spam' 'Jam

Re:GNU Parallel – The command line power tool by seryoiupfurds on Wednesday August 14, 2013 @12:18PM (#6212386)
It looks like it's only single-quoting the characters that need it, in his example the newlines.
Re:GNU Parallel – The command line power tool by lotsofcows on Wednesday August 14, 2013 @09:20AM (#6211268)
Quoting is nice. That's better than bash -x debug mode too.
Re:GNU Parallel – The command line power tool by rcthompson on Wednesday August 14, 2013 @03:39AM (#6210315)
What if your command has a pipe in it? Then putting echo in front won't work, because the command after the pipe is still executed. The dry run option always works, and doesn't require editing the command itself.
Re:GNU Parallel – The command line power tool by dredmorbius on Wednesday August 14, 2013 @12:33AM (#6209944)
Nice. I just had to check to see if xargs has a similar feature. It doesn't, though the --no-run-if-empty and --verbose options are both handy. I believe I've used xargs with "echo <commandlist>" to proof output before committing it.

You can simply re-run that piped to bash (or your shell of choice) to execute commands if you wish (say, if parallel isn't available).

E.g.,

     echo foo bar baz | xargs -n1 -t echo ls | bash
... will execute 'ls foo; ls bar; ls baz', while showing the expanded command.
Re:GNU Parallel – The command line power tool by rcthompson on Wednesday August 14, 2013 @03:41AM (#6210322)
Yes, you can use echo, but that won't work if the command is something like "ls DIR | wc -l".
Re:GNU Parallel – The command line power tool by dredmorbius on Wednesday August 14, 2013 @11:54AM (#6212232)
Depending on how you want to do your counts or piping, you could run that after the xargs / parallel execution, which would be much more efficient (fewer processes and execs) anyhow.