darkPotato

My understanding is that the hallucination is, out of all the possibilities, the most probable one (ignoring temperature). So the hallucination is the most probable sequence of tokens at that point. The model may be able to predict an "I don't have that information" given the right context. But ensuring that in general is an open question.

Great piece!

Ahaha, luckily /s I am a bit of a weirdo and I like to delve deeper into things related to my job.

I was taught that a deeper understanding leads to better software/solutions and I strive to live up to my mentor dedication :)

Thank you, I will give your resource a read :)

Hi, would you recommend this book in 2024?