Re:Simdjson – Parsing Gigabytes of JSON per Second
by AtlasBarfed on Thursday February 21, 2019 @10:15PM
(#19222815)
well if you need indexed lookups, then use a database
if you're doing "table scan" processing of entire datasets, sure just-a-bunch-of-files would work too.
Databases can be surprisingly fast for things like that, since high performance file i/o is full of tricky/annoying stuff that databases have already optimized for.
if you're doing "table scan" processing of entire datasets, sure just-a-bunch-of-files would work too.
Databases can be surprisingly fast for things like that, since high performance file i/o is full of tricky/annoying stuff that databases have already optimized for.