News for hackers. Stuff that matters.

A comment on In-memory vs. disk-based DB: Why do you need a larger than memory architecture?. Parent comment

Re:In-memory vs. disk-based DB: Why do you need a larger tha... by refset on Saturday September 02, 2023 @05:47PM (#37365816)
In a similar vein, this was news to me recently:

> here’s a chart comparing the throughputs of typical memory, I/O and networking technologies used in servers in 2020 against those technologies in 2023

> Everything got faster, but the relative ratios also completely flipped

> memory located remotely across a network link can now be accessed with no penalty in throughput

The graphs demonstrate it very clearly: https://blog.enfabrica.net/the-next-step-in-high-performance...

[ Parent | on HN ]
Re:In-memory vs. disk-based DB: Why do you need a larger tha... by jandrewrogers on Saturday September 02, 2023 @07:14PM (#37366293)
Yeah, I think this is a brilliant thing in part because it makes disaggregation of hardware infrastructure plausible for high-performance, high-scale data-intensive workloads. It also turns some deeply embedded assumptions about software design and architecture for things like databases completely on their head. This shift in hardware balance is probably the biggest change to fundamental assumptions in database architecture since SSDs started to become a thing, and most people haven't internalized the implications yet.

It is an fun time to be working in high-scale data systems.

[ Parent | on HN ]