News for hackers. Stuff that matters.
Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise by lumost on Sunday May 17, 2026 @01:34PM (#48171069)
Not my area either! But my understanding is that there are more efficient methods of representing static numbers when you can skip the vram lookup.

https://taalas.com/

Is an example startup in this area claiming 16k tok/s on an asic for llama 8b. Qwen has a 27b model at opus 4.5 quality.

Re:Every AI Subscription Is a Ticking Time Bomb for Enterprise by jazzyjackson on Sunday May 17, 2026 @02:06PM (#48171485)
Neat, thanks for the link