Re:A lot of complex “scalable” systems can be done with a si...
by vchak1 on Monday December 30, 2019 @11:24AM
(#21914403)
Need to understand your domain better, but in many cases, the 250GB csv can be compressed down quite effectively using a columnar representation. And the columns can (potentially) be processed using simd/gpu based approaches to where a single server would outrun a cluster. Food for thought..
[ Parent
| on HN ]
There are no comments on this comment yet.