News for hackers. Stuff that matters.

A comment on Inversion: Fast, Reliable Structured LLMs. Parent comment

Re:Inversion: Fast, Reliable Structured LLMs by Incipient on Tuesday March 19, 2024 @03:40AM (#39753694)
Have you seen any blog posts that have some details on this? I can imagine, roughly, the concept but it sounds interesting and I'd like to get a better understanding.
[ Parent | on HN ]
Re:Inversion: Fast, Reliable Structured LLMs by azeirah on Tuesday March 19, 2024 @01:23PM (#39758126)
Yeah, dottxt has a post on this, it's a technique starting with a c I believe, something like continuum or something?

The op also has something about compressing finite state machines, it's basically the same thing with slightly different details in the implementation.

[ Parent | on HN ]
Re:Inversion: Fast, Reliable Structured LLMs by fzysingularity on Tuesday March 19, 2024 @02:47PM (#39758956)
Check out outlines by .txt : https://github.com/outlines-dev/outlines

sglang: https://arxiv.org/abs/2312.07104

[ Parent | on HN ]
Re:Inversion: Fast, Reliable Structured LLMs by Incipient on Tuesday March 26, 2024 @02:03AM (#39824657)
Thanks!
[ Parent | on HN ]