News for hackers. Stuff that matters.

A comment on Alpaca- An Instruct Tuned Llama 7B. Responses on par with txt-DaVinci-3. Demo up. Parent comment

Re:Alpaca- An Instruct Tuned Llama 7B. Responses on par with... by dongping on Monday March 13, 2023 @08:01PM (#35145171)
That's exactly why bitsandbytes has a threshold parameter to control the quantization.
[ Parent | on HN ]
Re:Alpaca- An Instruct Tuned Llama 7B. Responses on par with... by magicalhippo on Monday March 13, 2023 @08:11PM (#35145269)
Nice, good to know, thanks!
[ Parent | on HN ]