Smollm3: Smol, multilingual, long-context reasoner LLM

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by segmondy on Tuesday July 08, 2025 @09:53PM (#44505653)

H100 are going for about $3/hr, 384243 ~ $28k

[ Parent | on HN ]

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by jrk on Tuesday July 08, 2025 @11:38PM (#44506134)

This is indeed a reasonable cost estimate for competitive short-term H100 rentals (source: much SemiAnalysis coverage, and my own exploration of the market), but there is a critical error (besides the formatting glitch with `*`):

It was 24 days (576 hours) not 24 hours. $663,552 @ $3/hr.

[ Parent | on HN ]

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by mromanuk on Wednesday July 09, 2025 @08:54AM (#44509470)

According to Runpod pricing page, you can run H100 for $2.39, it can go as lower as $528,629.76

WARNING: This is highly speculative and napkin math

H200 (141 GB HBM3 - $3.99/h - 1.4x perf) 216 x 24 x 17 = 88128h = 351.895,104 (17 days and 216 cards)

B200 (192 GB HBM3e - $5.99/h - 2.8x perf) 158 x 24 x 9 = 34128h = $204.426,72

Probably wrong math, should be more efficient and cheaper. Doubt that they have 100/200 cards available for that long.

Source: I've only trained using RTX4090 and stuff like that with 8 cards.

Not affiliated in any way with Runpod.

[ Parent | on HN ]

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by dr_kretyn on Tuesday July 08, 2025 @10:58PM (#44505979)

The price just keeps on dropping with each comment. Anyone going to estimate it for less?

What's the source for $3/h?

[ Parent | on HN ]

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by pests on Wednesday July 09, 2025 @12:10AM (#44506274)

They miscalculated only 24 hours, not 24 days, so their number is off by a factor of 24.

[ Parent | on HN ]

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by jazzyjackson on Tuesday July 08, 2025 @10:11PM (#44505754)

Take this brother, \*, it may serve you well

[ Parent | on HN ]

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by YetAnotherNick on Wednesday July 09, 2025 @04:23AM (#44507506)

You can buy for $2.2/GPU/hr for on-demand and likely around $2 for this big order.

[1]: https://datacrunch.io/products#H100

[ Parent | on HN ]

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by social_quotient on Wednesday July 09, 2025 @05:40AM (#44507964)

Runpod is worth a look for these on demand workloads https://www.runpod.io/pricing I use a lot for ffmpeg workloads.

Found this a few days ago which might be neat for finding cheaper https://www.primeintellect.ai/

No affiliation with either

[ Parent | on HN ]

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by dconden on Thursday July 17, 2025 @06:42PM (#44599108)

Adding one more that's worth a look https://www.shadeform.ai

[ Parent | on HN ]

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by lhl on Wednesday July 09, 2025 @09:31AM (#44509849)

You can go much lower: https://gpulist.ai/

[ Parent | on HN ]