Sharding a simple bash script across multiple nodes is one of the original (and still one of the most common) uses of Pachyderm.

We actually have a tutorial based on it: https://github.com/pachyderm/pachyderm/blob/master/doc/examp...

(disclosure: I work at Pachyderm. https://pachyderm.io/)