News for hackers. Stuff that matters.
Re:Accelerating GPT-5.6 Sol Ultrafast by petu on Thursday August 13, 2026 @03:30PM (#49290820)
I have no idea, but I've assumed that batching can't work on Cerebras.

Batching works because of severe memory bottleneck, but Cerebras whole thing is serving models out of "L1 cache" (?).

There are no comments on this comment yet.