News for hackers. Stuff that matters.

A comment on .txt raises $11.9M to make language models programmable. Parent comment

Re:.txt raises $11.9M to make language models programmable by imtringued on Saturday October 19, 2024 @06:16AM (#41886908)
You mean this https://lmsys.org/blog/2024-02-05-compressed-fsm/
[ Parent | on HN ]
Re:.txt raises $11.9M to make language models programmable by OutOfHere on Saturday October 19, 2024 @09:29AM (#41887652)
It has a clever way to decode multiple valid tokens at once, rather than just one token at a time.

Corresponding project link: https://github.com/sgl-project/sglang

[ Parent | on HN ]