News for hackers. Stuff that matters.
Re:Alpaca: A Strong Open-Source Instruction-Following Model by eulers_secret on Monday March 13, 2023 @06:18PM (#35143829)
Another great option is https://github.com/oobabooga/text-generation-webui

The 7B model will run without changes on a 3080. The 13B 4-bit model also runs on a 3080.

This Reddit post has the instructions I followed: https://old.reddit.com/r/LocalLLaMA/comments/11o6o3f/how_to_...

There are no comments on this comment yet.