News for hackers. Stuff that matters.

A comment on Consistency LLM: converting LLMs to parallel decoders accelerates inference 3.5x. Parent comment

Re:Consistency LLM: converting LLMs to parallel decoders acc... by nsagent on Wednesday May 08, 2024 @06:59PM (#40303559)
You might like, the Infinigram paper then. It was discussed recently:

https://news.ycombinator.com/item?id=40266791

[ Parent | on HN ]

There are no comments on this comment yet.