News for hackers. Stuff that matters.
Re:DeepInfer, our in-house inference framework, now open source by awasum_yannick on Tuesday October 20, 2026 @06:19AM (#50163891)
This probably makes enterprise private inference cheaper. Wonder if this can be generalized to server other LLMs not just DeepSeek...should not be too hard

There are no comments on this comment yet.