News for hackers. Stuff that matters.
Re:Samsung Announces 'Shinebolt' HBM3E Memory: HBM Hits 36GB... by aperrien on Thursday October 26, 2023 @02:29AM (#38022370)
How soon do people think that we'll get in-memory computing chips?
Re:Samsung Announces 'Shinebolt' HBM3E Memory: HBM Hits 36GB... by charcircuit on Thursday October 26, 2023 @02:36AM (#38022423)
Never in practical designs due to thermal issues
Re:Samsung Announces 'Shinebolt' HBM3E Memory: HBM Hits 36GB... by dvh on Thursday October 26, 2023 @03:52AM (#38022924)
If we create 1-dimensional memory we could radiate heat to 2 dimensions.
Re:Samsung Announces 'Shinebolt' HBM3E Memory: HBM Hits 36GB... by nvgeele on Thursday October 26, 2023 @03:11AM (#38022644)
Re:Samsung Announces 'Shinebolt' HBM3E Memory: HBM Hits 36GB... by moring on Thursday October 26, 2023 @06:58AM (#38023972)
Computing in the actual storage banks seems a bit over-the-top to me, but I always wondered about computing in the "currently open row". It seems like an obvious optimization candidate for fast memset() and memcpy(), by setting that row from another source than the storage bank, selectively loading or storing it, and shifting its contents around.
Re:Samsung Announces 'Shinebolt' HBM3E Memory: HBM Hits 36GB... by namibj on Thursday October 26, 2023 @07:58AM (#38024400)
Two recent (weeks) papers/presentations on: doing just that (LUT at the row buffer) https://youtu.be/9t1FJQ6nNw4; doing parallel sense in NAND for computing AND between rows (which they call pages, but in DRAM they're called rows. It's the same concept, though.) https://youtu.be/QWL2Rw_VhHg
Re:Samsung Announces 'Shinebolt' HBM3E Memory: HBM Hits 36GB... by bjourne on Thursday October 26, 2023 @08:13AM (#38024505)
As soon as memristors become viable for general-purpose computing.
Re:Samsung Announces 'Shinebolt' HBM3E Memory: HBM Hits 36GB... by RetroTechie on Thursday October 26, 2023 @09:00AM (#38024930)
I've always thought it logical to integrate RAM & cpu.

Look over the course of history: there's often a roughly-fixed ratio between cpu performance & RAM bandwidth (+ size), and cpu/memory <-> graphics interconnect speed. Any of those factors get too far out of wack, and you've got a machine with poor bang/$.

GPU integration is old now. Ok I've read there's a mismatch between silicon processes used for logic (like cpu/gpu etc) and memory? But hey, this is 2023. Chiplets? Stacked dies? Or just do the best with available tech? It's not like there are no ICs that integrate RAM & compute.

With the right architecture, the "memory wall" could be (mostly) a thing of the past. With enough cores & on-chip RAM bandwidth, maybe specialized gpu processing wouldn't even be needed anymore? For example:

https://en.wikipedia.org/wiki/Massively_parallel_processor_a...

Re:Samsung Announces 'Shinebolt' HBM3E Memory: HBM Hits 36GB... by reportingsjr on Thursday October 26, 2023 @11:54AM (#38027328)
Who knows? IBM Research just released info on their updated compute in memory chip [0]. Intriguing, but it doesn't provide a ton of insight in to whether or not it will be commercially viable any time soon.

0: https://research.ibm.com/blog/northpole-ibm-ai-chip