Re:Ask HN: Is KDB a sane choice for a datalake in 2024?
by kragen on Monday June 10, 2024 @08:57PM
(#40641089)
my experience is that you can often compute a conservative approximation to the signals you're looking for that's valid over a range of parameters, vastly decreasing the data you have to ship across the wire
My questions implies the specific use case being discussed here. Backtesting is mostly about doing a lot of computations over the same data with different parameters, so you can prefetch data once and then iterate over it multiple times - the network penalty is paid only once.