News for hackers. Stuff that matters.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by alchemist1e9 on Tuesday March 28, 2023 @02:01PM (#35345237)
It’s unbelievable stuff. Does anyone know how much a single box costs? They are selling them it looks like.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by freeqaz on Tuesday March 28, 2023 @02:13PM (#35345410)
If you have to ask, you can't afford it!

Mostly teasing but my guess would be $500k+ since they'll likely price it so that it is the same $ as the equivalent NVIDIA cluster (or very close to it).

Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by alchemist1e9 on Tuesday March 28, 2023 @02:23PM (#35345581)
Actually if they are around $2M looks like my company can afford one. Given this is just getting started it looks promising as I’m sure future generations will be more affordable.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by sbierwagen on Tuesday March 28, 2023 @02:16PM (#35345461)
CS-1 cost "$2-3 million", CS-2 costs "several" million.

A single Nvidia H100 costs somewhere around $30,000 each, so a GPU server with every slot populated costs about $300,000.

Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by brucethemoose2 on Tuesday March 28, 2023 @02:42PM (#35345875)
ServeTheHome claims "HGX A100 platforms, when they are sold as single servers are generally in the $130K-$180K even leaving a very healthy margin for OEMs/ resellers"

https://www.servethehome.com/graphcore-celebrates-a-stunning...

Not sure about the H100, but it seems to be more supply constrained (hence pricier) atm.

Now, the real question is how many HGX nodes "equals" a single CS2 node. The math here is extremely fuzzy, as the benefit to such extreme node consolidation depends on the workload, and the CS-2 takes up less space, but the HGX cluster will have more directly accessible RAM and better turnkey support for stuff since its Nvidia.

Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by ericd on Tuesday March 28, 2023 @02:14PM (#35345429)
On the order of several million USD for the second gen system. Last I heard, they’re still at lowish volumes, selling some to national labs and the like.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by bubblethink on Tuesday March 28, 2023 @02:26PM (#35345629)
There is cloud pricing on the website. https://www.cerebras.net/product-cloud/
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by alchemist1e9 on Tuesday March 28, 2023 @03:29PM (#35346531)
This is actually really important from my perspective. It looks like an end user can work backwards from available inference hardware, or interference budget, required speed, then figure out a viable model size. Bring their own data and then fine tune or train from scratch.

This is getting so real so fast.