News for hackers. Stuff that matters.
Re:Show HN: VLLM with JSON Guided Generation by remilouf on Friday December 22, 2023 @11:20AM (#38735595)
We already support regex-guided generation in the library, and could easily make an API to serve this as well if that's a feature people want!
Re:Show HN: VLLM with JSON Guided Generation by jilijeanlouis on Friday December 22, 2023 @11:26AM (#38735686)
I need it yes. that would be amazing tbh.