News for hackers. Stuff that matters.
Re:Gopher – A 280B parameter language model by canjobear on Wednesday December 08, 2021 @12:22PM (#29487562)
It should have some uncertainty when it says there are no French-speaking countries in South America. French Guiana is there, but it's not clear it counts as a "country in South America" since it's part of France. Technically you could say France is (partially) a country in South America, and France definitely is French-speaking. The way the question is phrased is unclear as to whether French Guiana should count, and yet Gopher says that it is fully confident in its answer.

Not a good look to have an error on the landing page for your product.

Re:Gopher – A 280B parameter language model by singularity2001 on Wednesday December 22, 2021 @07:17AM (#29648255)
How would one train an additional output neuron for 'confidence'?
Re:Gopher – A 280B parameter language model by paunchy on Wednesday December 08, 2021 @12:58PM (#29488071)
I think you're missing the point. That section was to show that the model is sometimes wrong and lacks the self-awareness to be uncertain about that wrong answer.

They're transparently providing an example where their product doesn't work well. Find me another product, even an OSS project that does the same on their landing page.

Re:Gopher – A 280B parameter language model by canjobear on Wednesday December 08, 2021 @03:42PM (#29490216)
Ha, you're right. Whoops!
Re:Gopher – A 280B parameter language model by BillinghamJ on Wednesday December 08, 2021 @12:31PM (#29487700)
Is it not in that section specifically because they're showing failure situations?