News for hackers. Stuff that matters.
Re:Stability AI releases StableVicuna, a RLHF LLM Chatbot by CamperBob2 on Friday April 28, 2023 @05:27PM (#35747302)
Hopefully RedPajama will change things when (if) they release models based on their independent LLaMa recreation. Until that happens, it might make sense to use the LLaMa model as a stopgap for internal development.
Re:Stability AI releases StableVicuna, a RLHF LLM Chatbot by OkGoDoIt on Sunday April 30, 2023 @08:56PM (#35767997)
Exactly! It seems pretty clear that someone will reproduce llama and alpaca with a commercially viable model within the next few months to a year at the longest. So if you want to build something based on top of this technology, it makes sense to build it on top of llama/alpaca internally, and then swap it out with something commercially licensed when it’s available. Then you’ve got a huge head start on anyone who is waiting for the stars to align before they start trying to build something at all.