News for hackers. Stuff that matters.
Re:Lossless Acceleration of LLM via Adaptive N-Gram Parallel... by MacsHeadroom on Sunday April 21, 2024 @10:24PM (#40110972)
Who is already using speculative decoding? I haven't seen anything about it in the llama.cpp or ollama docs.
Re:Lossless Acceleration of LLM via Adaptive N-Gram Parallel... by eshoyuan on Sunday April 21, 2024 @10:59PM (#40111102)