Re:LLMs by Hallucination Rate
by atleastoptimal on Thursday November 16, 2023 @04:02AM
(#38287185)
I tried b again and got German. What is it about German?
[ Parent
| on HN ]
Re:LLMs by Hallucination Rate
by consumer451 on Thursday November 16, 2023 @04:04AM
(#38287204)
The reddit post I linked to has a few different examples. As far as I can see only B triggered German.
I did some google searches like "letter B in German frequency". Of the languages I searched, German has the highest frequency of Bs (1.96%), the closest are English and Spanish (1.49%), many others are around 1%. So, true to its nature being a statistical token predictor.
Re:LLMs by Hallucination Rate
by RugnirViking on Thursday November 16, 2023 @10:33AM
(#38290790)
interesting, I also got german !
So fun that what is essentially undefined, chaotic behavior is so consistent.
Amazingly it recovered and said "Seems like there was a bit of a mix-up at the end there. I hope the initial part with the letter "B" is helpful for your needs!" in the same response with all the B and german