News for hackers. Stuff that matters.

A comment on Megatron-Turing NLG 530B, the World’s Largest Generative Language Model. Parent comment

Re:Megatron-Turing NLG 530B, the World’s Largest Generative ... by sanxiyn on Monday October 11, 2021 @11:26PM (#28835738)
Yes for CPU, no for RAM. You can buy a computer with terabytes of RAM just fine. It's just expensive.
[ Parent | on HN ]
Re:Megatron-Turing NLG 530B, the World’s Largest Generative ... by soganess on Tuesday October 12, 2021 @01:34PM (#28842549)
Expensive is a really relative term right about now... 64gb DDR4 LRDIMMs could be had for about 250$ each on eBay before the chip shortage. While that price is a "good-ish deal", it really wasn't unheard of. A search I just did returns more than a few hits...

Now compare to single GPU prices...

[ Parent | on HN ]