In my biased opinion, I'd recommend using Reexpress to get reliable uncertainty quantification from LLMs. The video Tutorial 2 on our website demonstrates how to derive uncertainty estimates from the Mistral 7b model, but the basic principle is the same for any LLM: Simply include the output logits when uploading a document via the JSON lines format: https://re.express/