Re:How Dolt Stores Table Data (2020)
by zachmu on Monday August 08, 2022 @05:19PM
(#32391152)
Yup, there are several solutions you can employ.
Here's a more recent write-up on chunking that details some of them, but it mostly comes down to using a better hash function, and having a fail-safe max chunk size for truly pathological cases.
Here's a more recent write-up on chunking that details some of them, but it mostly comes down to using a better hash function, and having a fail-safe max chunk size for truly pathological cases.
https://www.dolthub.com/blog/2022-06-27-prolly-chunker/