Re:Launch HN: Datafold (YC S20) – Diff Tool for SQL Databases
by lukevp on Thursday August 06, 2020 @12:59PM
(#24072895)
Could you use the free tier for regression testing a subset? Like up to 1M either first, last or random sample? Or do the datasets themselves have to be prefiltered down to 1M results?
[ Parent
| on HN ]
Re:Launch HN: Datafold (YC S20) – Diff Tool for SQL Databases
by hichkaker on Thursday August 06, 2020 @02:17PM
(#24073847)
Yes, you could. The limit is for the source dataset size but you can prefilter it (there is an option to pass in free-form SQL query instead of table name when creating a diff).
For the majority of diffs we see with sampling applied, sample sizes are <1M rows (more is often impractical in terms of information gain for higher compute costs) especially if your goal is to assess the magnitude of the difference as opposed to get every single diverging row.