News for hackers. Stuff that matters.
Re:Detecting when LLMs are uncertain by tkellogg on Friday October 25, 2024 @03:22PM (#41948693)
Entropix gives you a framework for doing that sort of thing. The architecture is essentially to detect the current state, and then adjust sampler settings or swap in an entirely new sampler strategy.

You absolutely could experiment with pushing it into a denial, and I highly encourage you to try it out. The smollm-entropix repo[1] implements the whole thing in a Jupyter notebook, so it's easier to try out ideas.

[1]: https://github.com/SinatrasC/entropix-smollm

Re:Detecting when LLMs are uncertain by edwdt on Saturday October 26, 2024 @02:02AM (#41952894)