News for hackers. Stuff that matters.
Re:Claude Code weekly rate limits by flashgordon on Monday July 28, 2025 @03:49PM (#44714777)
wow - do you mind sharing any links to a specific setup? Also whats the biggest model anybody has run on this?
Re:Claude Code weekly rate limits by paxys on Monday July 28, 2025 @04:17PM (#44715088)
You can run a decent model on it, say highly quantized Qwen or Deepseek R1 getting 5-10 tokens/sec output, but it will be nothing in comparison to a commercial offering like Claude, o3 or Gemini. For that you need a datacenter-class GPU going for $50K-100K a pop.
Re:Claude Code weekly rate limits by mtkd on Tuesday July 29, 2025 @04:34AM (#44720708)
But a small collective running that box, especially spanning timezones, could potentially be a viable alternative or will be soon -- with obv privacy gains too
Re:Claude Code weekly rate limits by lossolo on Monday July 28, 2025 @04:00PM (#44714909)
Unfortunately, you will not be able to run any model on this that is comparable to the Claude models.
Re:Claude Code weekly rate limits by icelancer on Monday July 28, 2025 @04:21PM (#44715134)
Every model you run on that setup will be at best half as good as Sonnet 4.