News for hackers. Stuff that matters.

A comment on Takeoff Inference Server Is Now Open Source.

Re:Takeoff Inference Server Is Now Open Source by mezark on Tuesday August 01, 2023 @09:09AM (#36955486)
Drop in replacement for HF's TGI server. The fastest and easiest way to inference LLMs locally

Github: https://github.com/titanml/takeoff Docs: https://docs.titanml.co/docs/titan-takeoff/getting-started Discord: https://discord.gg/83RmHTjZgf

[ Parent | on HN ]

There are no comments on this comment yet.