News for hackers. Stuff that matters.

A comment on Small offline large language model – TinyChatEngine from MIT. Parent comment

Re:Small offline large language model – TinyChatEngine from MIT by PeterStuer on Monday December 18, 2023 @05:35AM (#38680982)
They have postprocessed the models specifically for size and latency. They published several papers on this.

Their optimized models are not downloaded from HF, but from dropbox. I have no idea why.

[ Parent | on HN ]

There are no comments on this comment yet.