News for hackers. Stuff that matters.
Re:Nvidia Unveils RTX 5880 Graphics Card with 14,080 CUDA Co... by theyinwhy on Sunday January 07, 2024 @02:40AM (#38899337)
I believe it when I see it. Lot's of companies in the field now and if I need to take a bet I would say Intel has way better chances to succeed with Gaudi than small vendor x.
Re:Nvidia Unveils RTX 5880 Graphics Card with 14,080 CUDA Co... by two_in_one on Sunday January 07, 2024 @03:12AM (#38899497)
Because it's not just a chip, it's everything else too. There were 2 startups in Boston, may be 500 meters apart, doing optical computing. 4 years and there is still no product. "everything else" is a lot. It's hardware and software. Just brilliant idea is not enough.
Re:Nvidia Unveils RTX 5880 Graphics Card with 14,080 CUDA Co... by visarga on Sunday January 07, 2024 @03:41AM (#38899624)
They are delivering Groq cards, nodes and rack. Not vaporware.

See an article from the press with details here: https://www.theregister.com/2020/09/29/groq_ai_dev_kit/

Re:Nvidia Unveils RTX 5880 Graphics Card with 14,080 CUDA Co... by two_in_one on Sunday January 07, 2024 @07:29PM (#38906740)
this is more recent and optimistic https://www.nextplatform.com/2023/11/27/groq-says-it-can-dep...

But I don't see any selling numbers or independent performance conformations.

Re:Nvidia Unveils RTX 5880 Graphics Card with 14,080 CUDA Co... by tome on Wednesday January 10, 2024 @06:52AM (#38939006)
> independent performance conformations.

Groq has just been added to the LLMPerf Leaderboard:

https://github.com/ray-project/llmperf-leaderboard#output-to...

(Disclosure: I work for Groq)

Re:Nvidia Unveils RTX 5880 Graphics Card with 14,080 CUDA Co... by visarga on Sunday January 07, 2024 @03:39AM (#38899612)
That's why I provided the demo link, see the tokens/second. They are running LLaMA 70B at about 260T/s without quantization. This is the fastest LLaMA2 model