News for hackers. Stuff that matters.

fsjayess

Re:LLM Inference Handbook on Friday July 11, 2025 @11:20AM (#44533173)
There is a big pie in the market around LLM serving. It make sense for a serving framework to extend into the space