Playing with Go: Embarrassingly Parallel Scripts

Re:Playing with Go: Embarrassingly Parallel Scripts by etrain on Monday December 03, 2012 @11:05AM (#4865995)

I realize it's a one-off, but you could potentially mix lines of output with a script like that.

If you gnu parallel (xargs++) installed - turn that second line into a script (and replace $line with $1).

  cat domains.txt | parallel -n 1 -P 50 script.sh

[ Parent | on HN ]

Re:Playing with Go: Embarrassingly Parallel Scripts by icebraining on Monday December 03, 2012 @11:30AM (#4866167)

Notice that with parallel, you don't need the -n 1, since that's the default.

[ Parent | on HN ]

Re:Playing with Go: Embarrassingly Parallel Scripts by etrain on Monday December 03, 2012 @11:45AM (#4866258)

Ah, didn't realize that - throwback to my xargs days! Thanks for the tip.

[ Parent | on HN ]

Re:Playing with Go: Embarrassingly Parallel Scripts by crusso on Monday December 03, 2012 @11:34AM (#4866192)

Thanks for the note on parallel, it looks to be an excellently useful tool. I can find a lot of ways to save time with it.

FYI: On OSX, there is a Homebrew formula (brew install parallel).

[ Parent | on HN ]

Re:Playing with Go: Embarrassingly Parallel Scripts by ole-tange on Tuesday December 04, 2012 @03:57AM (#4870079)

If you are looking for which domain point to 1.2.3.4:

   cat domains.txt | parallel -P 100 --tag host | grep 1.2.3.4

Somewhat slower runtime than the go-solution, but may be faster to write.

[ Parent | on HN ]