Re:State-of-the-art open-source chatbot, Vicuna-13B, just re...
by dragonwriter on Monday April 03, 2023 @07:29PM
(#35432883)
> a massive search operation, akin to finding the right temperature to bake a cake from all possible floats
...for each of 13 billion (for a model with that many parameters) different cakes, except that they aren’t like cakes because the “best" temperature for each depends on the actual temperatures chosen for the others.
...for each of 13 billion (for a model with that many parameters) different cakes, except that they aren’t like cakes because the “best" temperature for each depends on the actual temperatures chosen for the others.