Show HN: VLLM with JSON Guided Generation

Re:Show HN: VLLM with JSON Guided Generation by jilijeanlouis on Friday December 22, 2023 @11:17AM (#38735564)

this is really cool probably the most wanted feature in LLM open source. It would be nice to have regex support too?

do you plan to support regex?

[ Parent | on HN ]

Re:Show HN: VLLM with JSON Guided Generation by remilouf on Friday December 22, 2023 @11:20AM (#38735595)

We already support regex-guided generation in the library, and could easily make an API to serve this as well if that's a feature people want!

[ Parent | on HN ]

Re:Show HN: VLLM with JSON Guided Generation by jilijeanlouis on Friday December 22, 2023 @11:26AM (#38735686)

I need it yes. that would be amazing tbh.

[ Parent | on HN ]