samox
Re:
on Thursday February 29, 2024 @11:47AM (#39551811)
Hello fellow hackers,
I've always felt there is something missing to really exploit the power of dbt snapshots. So I've been working on plugging a DuckDb in browser to a snapshot table, and it looks like this :D
You can try it here , it is WIP or course but happy to hear your feedback:
https://app.data-drift.io/samox/tdf-datadrift/overview-db?sn...
I plan to release it as a dbt CLI, if you are interested give me a star, it gives me motivation and energy My repo
Re:Tracking SQLite Database Changes in Git
on Thursday November 02, 2023 @10:58AM (#38114371)
I felt it was related (database + git is quite a narrow scope), and not concurrent to the post (I did not comment on the DoltgreSQL post for instance). But, I admit I was looking for some personal gratification. Sorry it bothered you.
Re:Tracking SQLite Database Changes in Git
on Thursday November 02, 2023 @07:15AM (#38111801)
Sharing a personal project to display git based CSV :D
https://app.data-drift.io/41231518/samox/local-datadrift-rep...
Not sure how it could be plugged on this stuff, but sharing anyway :D
Re:Tracking SQLite Database Changes in Git
on Thursday November 02, 2023 @05:49AM (#38111128)
The entire database, no. But a table with slowly changing dimensions, or a table that "should not" change, git is a simple solution for snapshotting.
Show HN: DataDrift – Share metric update to you data consumers
https://app.data-drift.io/drift-overview
I've released this yesterday but there was some bugs and unclear data. Here is an example of a metric update and its impact.The goal behind this is to build trust on metric by explaining why it has changed, and that its under control by the data team.
Show HN: Visualize Your Metrics Like Never
https://app.data-drift.io/drift-overview
I want to provide a "Historical context" for data consumer, so they know that data can change, but that it's under control by the data team.I used random data for the moment. Will have a proper, coherent environment soon.Can't wait for your feedbacks !
Re:Show HN: DriftDB: Visualize Metric Impact Between Measurements
on Friday October 20, 2023 @05:12AM (#37953887)
I've tested it on mac only
Would love to get feedback, suggestions, or hear how you might find this useful!
Show HN: DriftDB: Visualize Metric Impact Between Measurements
https://pypi.org/project/driftdb/
Hey HN,I've been working on a project called DriftDB which helps visualize how a specific metric has changed between two measurements. If you've ever struggled with understanding the impact or shift in data metrics, this tool might be of interest!Key Features: - load your data (from a CSV) then make a change in that data and reload it - Display waterfall chart of the evolution of a...
Ask HN: Do you know any good data analysis news letter
I follow some in data engineering world. I was wondering if there was some more dedicated to frameworks, methods, technics (rather than technology)
Show HN: Lineage X Snapshot Tooling
Hello everyone, I've been working on this project for several month now and I've just released a Lineage page so I thought I could share it here.Data Drift is a tool to help data teams understand what changed in their data warehouse, and how that led to KPI instability.Here's an example: https://app.data-drift.io/42527392/Lucasdvrs/dbt-datagit/ove...You can "technically" install it by...
Non-moving data is a journey
Headless Context Layer
“Non moving data” is like “Bug free”, it's a lie
Re:Git for Your Data
on Monday July 10, 2023 @09:50AM (#36666423)
Do you think we need historization for data and that current technologies do not solve that problem ?
Upvote if yes !
Why data reports are not trusted
Show HN: WebhookStore = Yopmail for webhooks. Now available for teams
WebhookStore is basically Yopmail for webhooks. Free and Open source, for dev purpose. Any *.webhook.store is a public disposable url. Personal store: $YOU.github.webhook.store Team store: $ORG.github-org.webhook.store