News for hackers. Stuff that matters.
Re:gpulist – Craigslist for GPUs by AnotherGoodName on Wednesday February 14, 2024 @08:40PM (#39378115)
Well the cost of the gpus themselves is insane. A single h100 you can hold on your hand costs the around the same as an entire Tesla model 3.
Re:gpulist – Craigslist for GPUs by sjwhevvvvvsj on Wednesday February 14, 2024 @09:06PM (#39378286)
Less chance of fatal-to-operator malfunctioning tho.
Re:gpulist – Craigslist for GPUs by mikeweiss on Wednesday February 14, 2024 @11:25PM (#39379093)
Anyone have any predictions about when the prices will start going down significantly? Anyone think we could see price per hour per GPU cut in half by July?
Re:gpulist – Craigslist for GPUs by CamperBob2 on Thursday February 15, 2024 @12:38AM (#39379493)
When some more EUV fabs come online. So... 5-10 years min.
Re:gpulist – Craigslist for GPUs by mikeweiss on Thursday February 15, 2024 @11:27AM (#39384692)
Looks like we have a bunch of start-up cloud companies who have money being thrown at them by god knows who buying thousands of H100s and other GPUs. These are all going to come online around the same time in early spring. I think we will see prices drop rapidly by June .
Re:gpulist – Craigslist for GPUs by rvnx on Wednesday February 14, 2024 @09:07PM (#39378297)
$30K<->$40K and it apparently costs Nvidia around $3.3K to manufacture an H100 GPU for info
Re:gpulist – Craigslist for GPUs by __loam on Wednesday February 14, 2024 @10:05PM (#39378635)
Cost to produce doesn't matter. The reason these things are so expensive is demand and the limited capacity of fabs to produce them.
Re:gpulist – Craigslist for GPUs by WithinReason on Thursday February 15, 2024 @02:59AM (#39380201)
You pay mostly for CUDA, not the GPU