Re:Lenovo Has a CXL Memory Monster with 128x 128GB DDR5 DIMMs
by rustcleaner on Wednesday November 20, 2024 @01:29AM
(#42191283)
Large Language Models.
Re:Lenovo Has a CXL Memory Monster with 128x 128GB DDR5 DIMMs
by rustcleaner on Wednesday November 20, 2024 @01:29AM
(#42191285)
Qubes OS.
Re:Lenovo Has a CXL Memory Monster with 128x 128GB DDR5 DIMMs
by moomoo11 on Wednesday November 20, 2024 @02:32AM
(#42191559)
Dumb question but why don’t we see more cracked out high memory machines? I mean like 1 petabyte RAM.
Or do these already exist
Re:Lenovo Has a CXL Memory Monster with 128x 128GB DDR5 DIMMs
by guenthert on Wednesday November 20, 2024 @05:09AM
(#42192410)
I'd think the market share for applications which need huge amount of space, but little CPU processing power and memory transfer rate is rather small.
Lenovo's slides indicate that they foresee this server be used for in-memory data bases.
Weren't there also distributed fs where the meta-data server couldn't be scaled out?
Re:Lenovo Has a CXL Memory Monster with 128x 128GB DDR5 DIMMs
by eqvinox on Wednesday November 20, 2024 @09:34AM
(#42194227)
We don't see more of these machines because most tasks are better served by a higher number of smaller machines. The only benefit of boxes like this is having all of that RAM in one box. Very few use cases need that.
Re:Lenovo Has a CXL Memory Monster with 128x 128GB DDR5 DIMMs
by moomoo11 on Wednesday November 20, 2024 @08:22PM
(#42200049)
Would be fun for a graph db
Re:Lenovo Has a CXL Memory Monster with 128x 128GB DDR5 DIMMs
by smolder on Wednesday November 20, 2024 @03:11AM
(#42191737)
Serving remote desktops to several hundred developers. Maybe a video content server for a netflix or youtube type business. Hosting a large search index? Some kind of scientific computing?
Re:Lenovo Has a CXL Memory Monster with 128x 128GB DDR5 DIMMs
by HeatrayEnjoyer on Wednesday November 20, 2024 @03:51AM
(#42191960)
A half dozen GPT-4 instances
Re:Lenovo Has a CXL Memory Monster with 128x 128GB DDR5 DIMMs
by metadat on Wednesday November 20, 2024 @11:39AM
(#42195659)
LLM inference processors (GPUs) don't use DDR, it uses special, costly stacked HBM ram soldered to the board.
I tested out running Llama on a 512GB machine, it's rather slow and inefficient. Maybe 1-token/sec.
Re:Lenovo Has a CXL Memory Monster with 128x 128GB DDR5 DIMMs
by guenthert on Wednesday November 20, 2024 @05:03AM
(#42192376)
Numeric simulation (HPC). Some, not all, simulations need lots of memory. In 2018 larger servers running such had 1TiB, so I'm not the least surprised that six years later it's 16.
Good for a database, maybe.
What else?