News for hackers. Stuff that matters.
Re:How I Fight AI Brain Fry by FuckButtons on Sunday November 08, 2026 @03:55PM (#50417146)
Unless we get some kind of very different architecture I’m not sure we’re going to get a 10-100x improvement any time soon, api models will always preference throughput over individual task latency, so any improvement that sacrifices serial decode for better parallelism is going to be more economically viable.

There are no comments on this comment yet.