News for hackers. Stuff that matters.
Re:Every Way to Get Structured Output from LLMs by anonymoushn on Tuesday June 18, 2024 @07:54AM (#40716700)
At earlier layers the activations don't correspond as cleanly to tokens, and I expect that vendor APIs for proprietary LLMs wouldn't let you do anything like this.

There are no comments on this comment yet.