News for hackers. Stuff that matters.

A comment on Alpaca- An Instruct Tuned Llama 7B. Responses on par with txt-DaVinci-3. Demo up.

Re:Alpaca- An Instruct Tuned Llama 7B. Responses on par with... by rjb7731 on Monday March 13, 2023 @02:45PM (#35140467)
The inference on the gradio demo seems pretty slow, about 250 seconds for a request. Maybe I am too used to the 4-bit quant version now ha!
[ Parent | on HN ]
Re:Alpaca- An Instruct Tuned Llama 7B. Responses on par with... by sebzim4500 on Monday March 13, 2023 @05:31PM (#35143079)
I'm sure it's partially the HN hug of death.
[ Parent | on HN ]