News for hackers. Stuff that matters.
Re:New x86 8U servers with 32TB RAM, 480 physical cores, 15 ... by endisneigh on Tuesday August 15, 2023 @05:51PM (#37139743)
With 32TB of ram it looks appealing to not even bother with a RDBMS and just use a full text database and keep everything in memory lol.
Re:New x86 8U servers with 32TB RAM, 480 physical cores, 15 ... by at_a_remove on Tuesday August 15, 2023 @06:41PM (#37140232)
You laugh but I have done some crazy speedups via ramdisk techniques.
Re:New x86 8U servers with 32TB RAM, 480 physical cores, 15 ... by doublerabbit on Tuesday August 15, 2023 @06:54PM (#37140356)
Early Minecraft for one.
Re:New x86 8U servers with 32TB RAM, 480 physical cores, 15 ... by MichaelZuo on Tuesday August 15, 2023 @06:02PM (#37139836)
It's not Big Data until it's over 32TB now! (or 64TB if your a Power10 user)
Re:New x86 8U servers with 32TB RAM, 480 physical cores, 15 ... by tomsmeding on Tuesday August 15, 2023 @06:59PM (#37140399)
If your data is mutable, as in most situations where one uses a database, you still have to hit the disk for writes and wait for a disk sync before continuing after the writes.

Reads are indeed fast, but a proper RDBMS will instantly use all of that memory capacity for caching anyway, meaning that you get the same read speeds even with the RDBMS. No need to change your code.

Re:New x86 8U servers with 32TB RAM, 480 physical cores, 15 ... by endisneigh on Tuesday August 15, 2023 @07:11PM (#37140507)
There are certain algorithms that are more used on in memory data structures that could be leveraged and never touch disk, not just simply boosting a relational database.

That being said my post was somewhat in jest

Re:New x86 8U servers with 32TB RAM, 480 physical cores, 15 ... by jauntywundrkind on Tuesday August 15, 2023 @07:07PM (#37140482)
If all that 15 PCIe x16 could be used for CXL at PCIe 5.0 speeds, that'd be just shy of 1TBps of attached memory, and one could hypothetically scale out to whatever size one wanted too.

Samsung dropped a 256GB CXL memory drive quite recently. These numbers should keep climbing and climbing. Very early days still yes, sure seems like in-memory will be enough for most users soon.

And CXL 3.0 introduces switching. So multiple servers can connect to the same memory device. Tons of interesting options to revise how things work as that starts to happen. The conventional ideas of networking are kind of silly when you can just have some other computer access the same memory.

Re:New x86 8U servers with 32TB RAM, 480 physical cores, 15 ... by fulafel on Wednesday August 16, 2023 @02:55AM (#37143619)
RAM size > data size has been the case for most DBs for a while, software has been slow in adapting to it.