News for hackers. Stuff that matters.
Re:Entropy of a Large Language Model output by cbzbc on Monday January 13, 2025 @11:25AM (#42685166)
Sorry, which particular part of that paper are you linking to, the graph at the top of that page doesn't seem to link to your comment?
Re:Entropy of a Large Language Model output by hexane360 on Monday January 13, 2025 @03:09PM (#42688367)
Fig. 8, where the model becomes poorly calibrated in terms of text prediction (Answers are "flattened" so that many answers appear equally probable, but below the best answer)