Re:Searching for a better persistent cache
by Const-me on Wednesday July 28, 2021 @08:40PM
(#27991496)
I'm not convinced the OP needs cache. I think they need more efficient file formats.
180ms for reading 140k items, each one is 16 byte GUID + up to 7 characters of text = 18.7 MB/second.
For sequential access from a local disk, that's very slow. Old spinning hard drives delivered like 100 MB/sec, modern SSDs are way faster, SATA ones are often limited with bus bandwidth which is 600 MB/sec.
180ms for reading 140k items, each one is 16 byte GUID + up to 7 characters of text = 18.7 MB/second.
For sequential access from a local disk, that's very slow. Old spinning hard drives delivered like 100 MB/sec, modern SSDs are way faster, SATA ones are often limited with bus bandwidth which is 600 MB/sec.