News for hackers. Stuff that matters.
Re:Amazon Timestream – Fast, scalable, fully managed time se... by cthalupa on Wednesday November 28, 2018 @11:21PM (#18558080)
>The core of Amazon's timeseries db likely doesn't fit into a CPU's L1 cache. It does with KDB :)

Does it?

https://kx.com/discover/in-memory-computing/ seems to indicate that it takes up ~600 Kb (I'm not sure if this is bits or bytes, but even if it's bits, that turns into 75KB)

L1 cache is per core. Skylake Xeons have a 64KB cache per core, 32KB for data and 32KB for instructions. Even with an even split there, you're not fitting 75KB (or 600KB) into the L1 cache.

Bits would be a weird measurement to use when talking about memory utilization, so I'm pretty sure that it's 600 kilobytes. You're not anywhere close to fitting that into the L1 cache. L2 cache, sure. But you get the relatively spacious 1 megabyte for L2.

I'm also not sure that the "core" fitting into the CPU cache is particularly meaningful for performance anyway. it doesn't say anything about how much outside of the core gets used, how big the working set size is for your workload, how much meaningful work is done on that working set of data, etc. If you're frequently using parts of the software that don't fit in the cache, or getting evicted from it for other code, or your working set of data doesn't fit in the cache and you're constantly going to main memory for the data you're working on, the "core" fitting in L1 cache (or L2 cache, which looks more realistic) is going to be basically meaningless.

Re:Amazon Timestream – Fast, scalable, fully managed time se... by SEJeff on Thursday November 29, 2018 @10:13AM (#18560738)
Gah, I meant L2 cache, but was being entirely too smug. I remember a presentation a KX rep gave at our office a few jobs ago where this was one of their bullet points. I found it amusing, and a bit odd.
Re:Amazon Timestream – Fast, scalable, fully managed time se... by cthalupa on Thursday November 29, 2018 @12:55PM (#18562143)
Gotcha! Definitely an interesting marketing point. I probably would have had the same reaction :)