News for hackers. Stuff that matters.

emaghsoudi

Thank you, this was very helpful. Data.world seems to provide a lot of features (governance, collaboration, data lineage, etc) I found Manta while looking at Data.world which is specific to data lineage and seems to be what I was looking for. I just don't know if it can handle manual rules yet (like rules defined in a Python process using Pandas code) or if it can only show data lineage in databases

Ask HN: Any tool to create diagram for data lineage and ETL rules?

Our BAs typically use Excel sheets to show how a field from a source system has to translate to destination. Is there a tool out there that would allow me to create a diagram to show all the rules associated with fields (ex. take the sum of field A and B and divide by C from source and that'll be field D in destination) AND be able to show data lineage at a high level so that I can see all the...

( Read More... | 6 comments | 12 points | on HN )