News for hackers. Stuff that matters.
Re:DeepInfer, our in-house inference framework, now open source by awasum_yannick on Tuesday October 20, 2026 @06:19AM (#50163891)
This probably makes enterprise private inference cheaper. Wonder if this can be generalized to server other LLMs not just DeepSeek...should not be too hard
Re:DeepInfer, our in-house inference framework, now open source by pluc on Tuesday October 20, 2026 @06:29AM (#50164004)