News for hackers. Stuff that matters.
Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by stingraycharles on Wednesday July 23, 2025 @08:42AM (#44658572)
So, does that mean that in general for the most modern high end LLM tools, to generate ~1500 tokens per seconds you need around $500k in hardware?

Checking: Anthropic charges $70 per 1 million output tokens. @1500 tokens per second that would be around 10 cents per second, or around $8k per day.

The $500k sounds about right then, unless I’m mistaken.

Re:Cerebras Launches Qwen3-235B, Achieving 1,500 Tokens per ... by andruby on Wednesday July 23, 2025 @09:36AM (#44659102)
62 days to break even, that would be a great investment