News for hackers. Stuff that matters.
Re: by crowwork on Sunday November 24, 2024 @07:05PM (#42231802)
XGrammar is an open-source library for efficient, flexible, and portable structured generation. Bring 2x-10x speedup in grammar grammar-guided(JSON and CFG) LLM serving.

There are no comments on this comment yet.