News for hackers. Stuff that matters.
Re:Every Way to Get Structured Output from LLMs by gdiamos on Tuesday June 18, 2024 @03:16AM (#40714954)
You totally ignored the Lamini JSON output mode - which is full speed and supports enums for classifiers

https://lamini-ai.github.io/inference/json_output/

Re:Every Way to Get Structured Output from LLMs by hellovai on Tuesday June 18, 2024 @03:19AM (#40714977)
thats pretty cool! We'll update the page after taking a look at the library!