News for hackers. Stuff that matters.

A comment on Entropy of a Large Language Model output. Parent comment

Re:Entropy of a Large Language Model output by vletal on Monday January 13, 2025 @09:53AM (#42684014)
https://github.com/xjdr-alt/entropix
[ Parent | on HN ]
Re:Entropy of a Large Language Model output by Der_Einzige on Monday January 13, 2025 @11:04AM (#42684925)
Entropix will get it's time in the sun, but for now, the LLM academic community is still 2 years behind the open source community. Min_p sampling is going to end up getting an oral about it at ICLR with the scores it's getting...

https://openreview.net/forum?id=FBkpCyujtS

[ Parent | on HN ]
Re:Entropy of a Large Language Model output by diggan on Monday January 13, 2025 @12:15PM (#42685818)
> the LLM academic community is still 2 years behind the open source community

Huh, isn't it the other way around? Thanks to the academic (and open) research about LLMs, we have any open source community around LLMs in the first place.

[ Parent | on HN ]