Re:Tinygrad: Hacked 4090 driver to enable P2P
by wtallis on Friday April 12, 2024 @04:05PM
(#40017069)
If it supports DDR5 at all, then it should be at most a firmware update away from supporting 48GB dual-rank DIMMs. There are very few consumer motherboards that only have two DDR5 slots; almost all have the four slots necessary to accept 192GB. If you are under the impression that there's a widespread limitation on consumer hardware support for these modules, it may simply be due to the fact that 48GB modules did not exist yet when DDR5 first entered the consumer market, and such modules did not start getting mentioned on spec sheets until after they existed.
[ Parent
| on HN ]
Re:Tinygrad: Hacked 4090 driver to enable P2P
by imtringued on Saturday April 13, 2024 @05:15AM
(#40021702)
You don't want to use more than two slots because you only have two memory channels. The overclocking potential of DDR5 is extremely high when you only run two DIMMs. All the way up to 8000. Meanwhile if you go for populating all four slots, you are limited significantly below 5000. Almost a 50% performance drop if you are willing to overclock your RAM.
Re:Tinygrad: Hacked 4090 driver to enable P2P
by wtallis on Saturday April 13, 2024 @05:21AM
(#40021723)
If you want to run something that doesn't fit in 96GB of RAM, you'll get better performance from having enough RAM. Yes, having two dual-rank DIMMs per channel will force you to run at a slower speed, but it's still far faster than your SSD. The second slot per channel exists precisely because many people really do want to use it.