A Million Text Files and a Single Laptop

Re:A Million Text Files and a Single Laptop by coderzach on Tuesday March 08, 2016 @05:02PM (#11249115)

I don't think that's the case, the default behavior of gnu parallel is to buffer the entire output before outputting. The output will only be interleaved if the `--ungroup` option is used. Parallel also has --line-buffer, which will interleave lines, rather than arbitrary bytes.

[ Parent | on HN ]

Re:A Million Text Files and a Single Laptop by sigil on Tuesday March 08, 2016 @05:18PM (#11249248)

Are you suggesting that the command argument to `parallel` is shell that's parsed and reinterpreted by `parallel`?

Buffering the output would make more sense, but the OP's command isn't outputting to stdout, but rather appending directly to a file.

[ Parent | on HN ]

Re:A Million Text Files and a Single Laptop by gcr on Tuesday March 08, 2016 @09:56PM (#11250576)

Good point. The command should simply move the >>file outside of the quote, and then it will work.

[ Parent | on HN ]

Re:A Million Text Files and a Single Laptop by coderzach on Saturday March 12, 2016 @03:05PM (#11274281)

Oh, yeah, I read it as if the ">>" was outside.

[ Parent | on HN ]