News for hackers. Stuff that matters.
Re:Show HN: Explore large language models on any computer wi... by nattaylor on Saturday June 17, 2023 @12:34PM (#36371759)
At 512gb RAM, it uses https://huggingface.co/jncraton/LaMini-Flan-T5-248M-ct2-int8 which says

"This model is one of our LaMini-LM model series in paper "LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions". This model is a fine-tuned version of google/flan-t5-base on LaMini-instruction dataset that contains 2.58M samples for instruction fine-tuning"

There are no comments on this comment yet.