News for hackers. Stuff that matters.
Re:I ran Gemma 4 as a local model in Codex CLI by foobar10000 on Sunday April 12, 2026 @10:11PM (#47746744)
1 token ahead or 2?

It's interesting - imo we'll soon have draft models specifically post-trained for denser, more complicated models. Wouldn't be surprised if diffusion models made a comeback for this - they can draft many tokens at once, and learning curves seem to top out at 90+% match for auto-regressive ones so quite interesting..

Re:I ran Gemma 4 as a local model in Codex CLI by electroglyph on Monday April 13, 2026 @06:10AM (#47749978)
flow matching is making some strides right now, too