News for hackers. Stuff that matters.

A comment on State-of-the-art open-source chatbot, Vicuna-13B, just released model weights. Parent comment

Re:State-of-the-art open-source chatbot, Vicuna-13B, just re... by skrblr on Monday April 03, 2023 @05:48PM (#35431768)
It's in the name of the model - "Vicuna-13B" implies there are 13 billion parameters.
[ Parent | on HN ]
Re:State-of-the-art open-source chatbot, Vicuna-13B, just re... by MuffinFlavored on Monday April 03, 2023 @08:24PM (#35433363)
the way these LLMs work, there is a weight for each parameter? 13 billion weights? what is an example of a parameter?
[ Parent | on HN ]
Re:State-of-the-art open-source chatbot, Vicuna-13B, just re... by dragonwriter on Monday April 03, 2023 @10:01PM (#35434005)
A parameter is a variable for which a weight (a floating point value) is the concrete value.
[ Parent | on HN ]
Re:State-of-the-art open-source chatbot, Vicuna-13B, just re... by kragen on Monday April 03, 2023 @10:05PM (#35434040)
a weight is an example of a parameter

so is a bias, and presumably the biases are also in the same file with the weights

[ Parent | on HN ]