State-of-the-art open-source chatbot, Vicuna-13B, just released model weights

Re:State-of-the-art open-source chatbot, Vicuna-13B, just re... by mdaniel on Monday April 03, 2023 @07:08PM (#35432636)

To add to this excellent reply, I'll also point out that the reason folks want the weights is that they are the result of a massive search operation, akin to finding the right temperature to bake a cake from all possible floats. It takes a lot of wall clock time, and a lot of GPU energy, and a lot of input examples and counter-examples to find the "right" numbers. Thus, it really is better -- all things being equal -- to publish the results of that search to keep everyone else from having to repeat the search for themselves

[ Parent | on HN ]

Re:State-of-the-art open-source chatbot, Vicuna-13B, just re... by dragonwriter on Monday April 03, 2023 @07:29PM (#35432883)

> a massive search operation, akin to finding the right temperature to bake a cake from all possible floats

...for each of 13 billion (for a model with that many parameters) different cakes, except that they aren’t like cakes because the “best" temperature for each depends on the actual temperatures chosen for the others.

[ Parent | on HN ]

Re:State-of-the-art open-source chatbot, Vicuna-13B, just re... by EVa5I7bHFq9mnYK on Tuesday April 04, 2023 @04:07AM (#35436536)

It's 2^(16*13,000,000,000) different cakes.

[ Parent | on HN ]

Re:State-of-the-art open-source chatbot, Vicuna-13B, just re... by swader999 on Tuesday April 04, 2023 @06:33AM (#35437509)

Way better than paperclips.

[ Parent | on HN ]