Re:GPTs Are GPTs: An Early Look at the Labor Market Impact P...
by visarga on Monday March 20, 2023 @07:07AM
(#35229876)
Two models trained from different lineages won't hallucinate the same. When you want to check for hallucination the cost is to run the task on two models. For now. But soon it looks like LLMs will be better calibrated. It seems they are well calibrated after pre-training but become less calibrated after fine-tuning and RLHF. The last stage breaks its abilities to estimate confidnce scores correctly.
[ Parent
| on HN ]
There are no comments on this comment yet.