Re:ASK HN: Are there code standards for using Pandas DataFra...
by redff0000 on Thursday October 10, 2019 @12:10AM
(#21210804)
Sounds like you're mostly interested in provenance and lineage. Pandas doesn't really help with that and I haven't seen any serious efforts to build on top of pandas for it.
If you want to roll code, you could use decorators or overload pandas methods like joins to build a provenance graph.
If you don't want to roll code, you can treat the transform as a black box and define your inputs and outputs in terms of database/store tables.
If you want to roll code, you could use decorators or overload pandas methods like joins to build a provenance graph.
If you don't want to roll code, you can treat the transform as a black box and define your inputs and outputs in terms of database/store tables.