News for hackers. Stuff that matters.

A comment on Show HN: Explore large language models on any computer with 512MB of RAM. Parent comment

Re:Show HN: Explore large language models on any computer wi... by jncraton on Saturday June 17, 2023 @12:44PM (#36371874)
That's correct. The current base model is an int8 quantization of LaMini-Flan-T5-248M described here:

https://github.com/mbzuai-nlp/lamini-lm

I shared more details over on Reddit:

https://www.reddit.com/r/LocalLLaMA/comments/14btk3a/explore...

[ Parent | on HN ]

There are no comments on this comment yet.