News for hackers. Stuff that matters.

A comment on Show HN: Mr. Graph. A graph deifnition and execution library for Python.

Re:Show HN: Mr. Graph. A graph deifnition and execution libr... by schemescape on Wednesday March 15, 2023 @02:47PM (#35172910)
Slight tangent: is anyone aware of a library (in Python or JS… or C) for specifying DAG pipielines that supports caching results (based on input)?

Make is closest I’ve found, but there’s probably something better out there.

Edit: I should look at other build tools, but ideally I want a library.

Edit again: I will be running this locally. Forgot to mention that.

[ Parent | on HN ]
Re:Show HN: Mr. Graph. A graph deifnition and execution libr... by tjfl on Wednesday March 15, 2023 @03:01PM (#35173136)
Maybe Dagster with Assets?

https://docs.dagster.io/concepts/assets/software-defined-ass...

[ Parent | on HN ]
Re:Show HN: Mr. Graph. A graph deifnition and execution libr... by mstokholm on Wednesday March 15, 2023 @03:09PM (#35173236)
alkymi (https://github.com/MathiasStokholm/alkymi) is such a library (disclaimer: I'm the author). I built alkymi to help me cache complex data pipelines, while still having all the niceties of Python.
[ Parent | on HN ]
Re:Show HN: Mr. Graph. A graph deifnition and execution libr... by schemescape on Wednesday March 15, 2023 @03:12PM (#35173280)
I haven’t dug too deep yet, but this sounds exactly like what I was looking for, thanks!
[ Parent | on HN ]
Re:Show HN: Mr. Graph. A graph deifnition and execution libr... by brahbrah on Wednesday March 15, 2023 @06:46PM (#35175763)
fn_graph: https://github.com/BusinessOptics/fn_graph

(My favorite one ^)

pyungo: https://github.com/cedricleroy/pyungo

Loman: https://github.com/janushendersonassetallocation/loman

Tributary: https://github.com/timkpaine/tributary

[ Parent | on HN ]