Re:The Falcon has landed in the Hugging Face ecosystem
by orost on Monday June 05, 2023 @05:58PM
(#36204519)
You have to turn down temperature and/or p when you want accuracy. Otherwise you don't know if the model's read is bad, or if you just happened to get a low-probability outlier.
With the playground's defaults of t=0.8, p=0.9, I got the right answer 7/10 times.
With t=0.1, p=0.1, it's always exactly "The name of the cat that wears a blue tie is Jackson."
With the playground's defaults of t=0.8, p=0.9, I got the right answer 7/10 times.
With t=0.1, p=0.1, it's always exactly "The name of the cat that wears a blue tie is Jackson."