News for hackers. Stuff that matters.
Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by kridsdale1 on Friday November 22, 2024 @03:35PM (#42217180)
My human responses degrade when I’m heavily loaded and low on resources, too.
Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by TeMPOraL on Friday November 22, 2024 @03:47PM (#42217253)
Unrelated. Inference doesn't run in sync with the wall clock; it takes whatever it takes. The issue is more like telling a room of support workers they are free to half-ass the work if there's too many calls, so they don't reject any until even half-assing doesn't lighten the load enough.