News for hackers. Stuff that matters.
Re:Advancing the price-performance frontier with GPT‑5.6 by ericd on Thursday July 30, 2026 @04:47PM (#49115557)
You can kind of get a sense by running these things at home - I'm currently running Laguna. One interesting thing is that per stream doesn't actually slow down that much with multiple concurrents, because the bottleneck remains the memory bandwidth until pretty significant request depths, and then eventually you hit the GPU's limits. It's one of the big forces that pushes for centralization in this stuff, the fixed costs to run one are huge, the marginal costs of additional tenants, relatively small.

There are no comments on this comment yet.