News for hackers. Stuff that matters.
Re:Dolt is Git for Data by zachmu on Thursday June 23, 2022 @11:52AM (#31850869)
You're suffering from a failure of imagination.

Consider a CMS, one of the most common forms of database backed applications. What if you could give your customer a "dev" branch of all their data to make their changes on and test out new content, that you could then merge with back to prod after somebody reviews it in a standard PR workflow?

This is the workflow one of our earliest customers built. They run network configuration software, and they use Dolt to implement a PR workflow for all changes their customers make.

More details here:

https://www.dolthub.com/blog/2021-11-19-dolt-nautobot/

Re:Dolt is Git for Data by Johannesbourg on Thursday June 23, 2022 @12:12PM (#31851146)
Personally working with timeseries data my experience is that clients typically underestimate how much storage they need for a single state, let alone including historic versions. The decision people want more data, not more snapshots for a given storage spend. But that's timeseries.
Re:Dolt is Git for Data by hinkley on Thursday June 23, 2022 @12:40PM (#31851629)
They want more data but they don't want to pay for it. People want lots of things, doesn't mean they get it or deserve it.

I can't recall which it was but one of the timeseries databases was bragging on the fact that there are certain situations where scanning a block of data is as cheap as trying to add finer grained indexes to it, especially with ad hoc queries. They did a bunch of benchmarks that said block scanning with compression and parallelism was workable.

And while compression typically leads to write amplification (or very poor compression ratios), in a timeseries database, or a regular database architected in a timeseries-like fashion, modifying the old data is deeply frowned upon (and in fact I've heard people argue for quasi-timeseries behavior because modifying old records is so punishing, especially as the application scales), so as long as you can decide not to compress some pages - new pages - this is not a problem.

Re:Dolt is Git for Data by lazzlazzlazz on Friday June 24, 2022 @11:18AM (#31863592)
This is Hacker News. The norm is a deep, thoughtful understanding of the state of the art and a total inability to apply the imagination to the future.
Re:Dolt is Git for Data by password4321 on Thursday June 23, 2022 @01:56PM (#31852808)
See also: https://versionpress.com (not being actively developed)
Re:Dolt is Git for Data by zachmu on Thursday June 23, 2022 @03:39PM (#31854202)
If we were less busy we would adopt versionpress and port it to dolt, such a cool product. Some day.