Fast JSON Decoding for Local LLMs with Compressed Finite State Machine Posted by yeesian on Thursday March 07, 2024 @12:47AM from the lmsys.org dept. https://lmsys.org/blog/2024-02-05-compressed-fsm/ ( no comments | on HN )
There are no comments yet.