Re:Building a better and scalable system for data migrations
by vc289 on Tuesday October 29, 2024 @07:34PM
(#41990541)
It would be interesting to consider branchable DBs as part of the migration cycle, especially for forward and backwards time skips.
While not dealing with that kind of scale yet, our application (An AI Data Engineer that has done migration work for users) needs to do before and after comparisons and find diffs. We use a branchable DB to compute those changes efficiently (DoltGres)
Could be an interesting thing to consider since it's worked well for us for that part.
While not dealing with that kind of scale yet, our application (An AI Data Engineer that has done migration work for users) needs to do before and after comparisons and find diffs. We use a branchable DB to compute those changes efficiently (DoltGres)
Could be an interesting thing to consider since it's worked well for us for that part.
Our build if u wanna check that out too -> https://Ardentai.io