News for hackers. Stuff that matters.

A comment on Pypeline: A Python library for creating concurrent data pipelines. Parent comment

Re:Pypeline: A Python library for creating concurrent data p... by memoir2comment on Monday September 24, 2018 @12:06PM (#18058845)
snakemake does this trivially:

    rule analyze_country:
        input: 'whatever.{country}.txt'
        output: 'analysis.{country}.txt'
        shell:
            'run-analysis-on-country {input} {output} --country=country'

    rule analyze_target_countries:
        input: ['analysis.usa.txt', 'analysis.canada.txt', 'analysis.mexico.txt']
[ Parent | on HN ]
Re:Pypeline: A Python library for creating concurrent data p... by elsherbini on Monday September 24, 2018 @01:57PM (#18059808)
Small change, you have to use wilcards.country inside the shell call:

    rule analyze_country:
        input: 'whatever.{country}.txt'
        output: 'analysis.{country}.txt'
        shell:
            'run-analysis-on-country {input} {output} --country={wildcards.country}'
[ Parent | on HN ]