Re:Non-binary DDR5 is finally coming to save your wallet
by gaudat on Monday January 02, 2023 @10:41PM
(#34227324)
Non-binary (double / 1-bit) increments in capacity. From article:
Instead of jumping straight from a 32GB DIMM to a 64GB one, DDR5, for the first time, allows for half steps in memory density. You can now have DIMMs with 24GB, 48GB, 96GB, or more in capacity.
Re:Non-binary DDR5 is finally coming to save your wallet
by ansgri on Tuesday January 03, 2023 @11:14AM
(#34233342)
And I was excited about possible use of multiple signal levels per cell.. Seriously though, how's the state of analog or multi-level memory? With rather weak data preservation guarantees, of course. Could get to breakthrough performance per watt for AI and simulation applications, and more attainable than quantum computing.
Re:Non-binary DDR5 is finally coming to save your wallet
by TristanBall on Tuesday January 03, 2023 @01:08AM
(#34228322)
I can't imagine a commercial environment where this really matters.
Sub-optimal ram install layout makes minimal difference in performance one you get past "enough" for your workload - for a huge percentage of corporate workloads - and for those where it does matter, budgets tend to allow for it.
We all know RAM costs will usually be marginal compared to software costs, whether that's licensing, development, implementation, or all three!
Maybe, in very cost conscious smaller envs this might allow for slightly more options under the "buy the smallest number of the largest size dimms that we can, so we upgrade later without taking anything out" purchasing pattern.
But my experience of such envs is that they're cashflow sensitive, and they're actually ok with you filling a machine with smaller, cheaper dimms then rip and replacing to upgrade, even if the original ram still depreciating, because that cost comes out of a different months budget - especially if it's cheaper up front.
You do need to be upfront that that's the tradeoff decision you're making - but it'll be even less of an issue if you've got a way to reuse the replaced ram, even if it's of minimal benefit ( any use > wasted ).
For home users tho... um, nope, 8-32gb seem to cover 99% of users and probably even 50-80% of HN readers.
Gotta be honest tho, was expecting this to be about gender fluid memory (!?) or perhaps someone finding a way to efficiently encode more than 0/1 for better density.. so it was definitely a let down of an article.
Re:Non-binary DDR5 is finally coming to save your wallet
by hengheng on Tuesday January 03, 2023 @10:32AM
(#34232673)
Plenty of 12GByte laptops around, usually with 4 GByte soldered and 8 GByte added. Usually one would do that with two or three modules, it's just the split bus nature od ddr5 that makes for slightly weird packaging.
Actually my phone has 12GByte now that I think about it. It's more of a packaging and mechanical footprint thing than anything else.
Doesn't matter above four modules ofc, the server world will see very little of this.
Re:Non-binary DDR5 is finally coming to save your wallet
by vardump on Tuesday January 03, 2023 @11:34AM
(#34233685)
> Plenty of 12GByte laptops around, usually with 4 GByte soldered and 8 GByte added.
Since almost all of the laptop CPUs are dual memory channel, this is pretty bad for memory bandwidth. In the best case, just 4 GB has half the bandwidth. In the worst case all of the memory has just 50% performance.
Re:Non-binary DDR5 is finally coming to save your wallet
by mikewarot on Tuesday January 03, 2023 @06:40AM
(#34230301)
This is the kind of thing that will start happening as the price of transistors on ICs start to rise in response to the end of Moore's law.
A recent episode of Asianometry - The 3-D Transistor Transition[1] pointed out that gate prices hit their minimum with 28 nanometer processes,(13:17 in the video) and have now begun to rise.
So in the future, you'll pay more per gate, but they continue to be smaller and faster and lower power, so for the most part it's worth it.
Re:Non-binary DDR5 is finally coming to save your wallet
by aitchnyu on Tuesday January 03, 2023 @09:34AM
(#34231787)
For years I noticed my RAM vendors have been defining a kilobyte as 1000 bytes, and megabytes and gigabytes as multiples of that and I assume a 1 gigabyte chip will have 4.6% less cells than maximum. Dont have an intuitive idea why 33% less cells was not viable till now.
Re:Non-binary DDR5 is finally coming to save your wallet
by seanw444 on Tuesday January 03, 2023 @10:38AM
(#34232782)
The switch up of terminology annoys me still. Computers don't operate on decimal. Their hardware is built as such. It just seems like a way to mislead customers into buying less data than they think they're getting.
Re:Non-binary DDR5 is finally coming to save your wallet
by welterde on Tuesday January 03, 2023 @11:09AM
(#34233281)
The consumer doesn't care though how the computers operate internally, so using the normal SI definitions is the expectation, instead of redefining it just so you get some nice round numbers.
Re:Non-binary DDR5 is finally coming to save your wallet
by GuB-42 on Tuesday January 03, 2023 @12:33PM
(#34234695)
The "1024" scale is the weird one, even in computing, it only makes sense in a limited number of cases, and with modern computers, it is becoming more and more arbitrary.
Generally, that scale is only used for storage. A Gigabit network is 1000Mbps, a gigahertz processor is 1000 MHz, a megapixel camera has a million pixels, etc... Even for storage, tapes for instance have no real reason to use powers of two, the tape can be of any arbitrary length, same for disks. Blocks of data can use powers of two, but what is a block? It make be 4096 bytes for the OS, but more than that for the medium because of error correction, and less for the application because of headers.
Really, powers of two only make sense for randomly accessible storage, and that's probably why they tend to be only used for RAM and block sizes these days.
Re:Non-binary DDR5 is finally coming to save your wallet
by teaearlgraycold on Tuesday January 03, 2023 @10:33AM
(#34232687)
This seems like a marketing spin when they failed to make 32 Gigabit modules viable. It's the same thing as when AMD couldn't make 4 core CPUs reliably and sold a bunch as 3 core CPUs. "50% more cores!" "Sometimes you can unlock the 4th core!". Not that people who get a good deal and upgrade their system with these half-steps should be unhappy.
Does anyone with more knowledge of DDR5 memory know if 32 Gb modules are in use and if they are reliable and only double the cost of 16 Gb modules?
Re:Non-binary DDR5 is finally coming to save your wallet
by ksec on Wednesday January 04, 2023 @09:17AM
(#34245722)
>This seems like a marketing spin when they failed to make 32 Gigabit modules viable.
No. It is exactly as the article have stated, Instead of of offering Servers with 128GB of Memory, they now have the option to offer 96GB. This also give Cloud providers ( Or simple VPS providers ) to mix and match their offering with CPU to RAM ratio inside a single unit.
Or imagine, of you need more than 2TB of Memory, instead of jumping straight to 4TB, you now have the option of 3TB of Memory.
For hyperscalers like Amazon, this extra options could easily save them hundreds of millions if not billions.
Re:Non-binary DDR5 is finally coming to save your wallet
by wmf on Friday January 06, 2023 @02:03PM
(#34279274)
AFAIK 32 Gb dies would be too large to fit in the standard DDR5 package and thus they aren't made. Also presumably yield of 32 Gb dies would be lower than 24 Gb, although maybe not much due to sparing.
Re:Non-binary DDR5 is finally coming to save your wallet
by rowanG077 on Tuesday January 03, 2023 @04:46PM
(#34238544)
How does this work on a signaling level? The great advantage of doubling DRAM is that there are no invalid addresses. Every possible pointer you can generate is a word you can address. Is this invariant now horribly broken? E.g. a memory controller can request R/W to addresses that don't exist?
Re:Non-binary DDR5 is finally coming to save your wallet
by Tuna-Fish on Tuesday January 03, 2023 @08:33PM
(#34240737)
There are plenty of "invalid addresses" in DDR5 before this. All existing DDR5 modules regardless of size use the same command and addressing scheme, which allows for 3-bit chip id, 3-bit bank group id, 2-bit bank id, 16-bit row address and 7-bit column address. [0] This, combined with the 8-bit minimum burst (and ability to only address at 8-bit granularity), means that every single normal x64 DDR5 module has an "address space" of 256GB. Any modules smaller than that do not implement all of the features of the addressing system and the memory controller has to query them beforehand to find out which parts are implemented, and so which addresses are safe to use. (Different modules might use different parts of the system -- as in, modules of the same capacity implemented with older manufacturing tech might use more chipid bits and less row address bits or bank groups.) In no way is every possible pointer a word you can address.
[0]: and one as of yet unimplemented additional reserved bit for either row address or chip id that doubles capacity if it's ever used.
Sub-optimal ram install layout makes minimal difference in performance one you get past "enough" for your workload - for a huge percentage of corporate workloads - and for those where it does matter, budgets tend to allow for it.
We all know RAM costs will usually be marginal compared to software costs, whether that's licensing, development, implementation, or all three!
Maybe, in very cost conscious smaller envs this might allow for slightly more options under the "buy the smallest number of the largest size dimms that we can, so we upgrade later without taking anything out" purchasing pattern.
But my experience of such envs is that they're cashflow sensitive, and they're actually ok with you filling a machine with smaller, cheaper dimms then rip and replacing to upgrade, even if the original ram still depreciating, because that cost comes out of a different months budget - especially if it's cheaper up front.
You do need to be upfront that that's the tradeoff decision you're making - but it'll be even less of an issue if you've got a way to reuse the replaced ram, even if it's of minimal benefit ( any use > wasted ).
For home users tho... um, nope, 8-32gb seem to cover 99% of users and probably even 50-80% of HN readers.
Gotta be honest tho, was expecting this to be about gender fluid memory (!?) or perhaps someone finding a way to efficiently encode more than 0/1 for better density.. so it was definitely a let down of an article.
Actually my phone has 12GByte now that I think about it. It's more of a packaging and mechanical footprint thing than anything else.
Doesn't matter above four modules ofc, the server world will see very little of this.
Since almost all of the laptop CPUs are dual memory channel, this is pretty bad for memory bandwidth. In the best case, just 4 GB has half the bandwidth. In the worst case all of the memory has just 50% performance.
... until they update their browser.
A recent episode of Asianometry - The 3-D Transistor Transition[1] pointed out that gate prices hit their minimum with 28 nanometer processes,(13:17 in the video) and have now begun to rise.
So in the future, you'll pay more per gate, but they continue to be smaller and faster and lower power, so for the most part it's worth it.
[1] https://www.youtube.com/watch?v=i3dDslo9ibw
Generally, that scale is only used for storage. A Gigabit network is 1000Mbps, a gigahertz processor is 1000 MHz, a megapixel camera has a million pixels, etc... Even for storage, tapes for instance have no real reason to use powers of two, the tape can be of any arbitrary length, same for disks. Blocks of data can use powers of two, but what is a block? It make be 4096 bytes for the OS, but more than that for the medium because of error correction, and less for the application because of headers.
Really, powers of two only make sense for randomly accessible storage, and that's probably why they tend to be only used for RAM and block sizes these days.
Does anyone with more knowledge of DDR5 memory know if 32 Gb modules are in use and if they are reliable and only double the cost of 16 Gb modules?
No. It is exactly as the article have stated, Instead of of offering Servers with 128GB of Memory, they now have the option to offer 96GB. This also give Cloud providers ( Or simple VPS providers ) to mix and match their offering with CPU to RAM ratio inside a single unit.
Or imagine, of you need more than 2TB of Memory, instead of jumping straight to 4TB, you now have the option of 3TB of Memory.
For hyperscalers like Amazon, this extra options could easily save them hundreds of millions if not billions.
I would expect this to only make a difference for dedicated server offerings, and I imagine amazons margins will still be the same on a per-GB basis.
[0] - https://youtu.be/-EhDlXx3okU?t=1694
[0]: and one as of yet unimplemented additional reserved bit for either row address or chip id that doubles capacity if it's ever used.