News for hackers. Stuff that matters.

A comment on Every Way to Get Structured Output from LLMs. Parent comment

Re:Every Way to Get Structured Output from LLMs by HeatrayEnjoyer on Tuesday June 18, 2024 @03:43AM (#40715094)
Why not apply it at an earlier layer then?
[ Parent | on HN ]
Re:Every Way to Get Structured Output from LLMs by anonymoushn on Tuesday June 18, 2024 @07:54AM (#40716700)
At earlier layers the activations don't correspond as cleanly to tokens, and I expect that vendor APIs for proprietary LLMs wouldn't let you do anything like this.
[ Parent | on HN ]