it's nice to see progress. from what I understand, this is already actionable (https://github.com/hao-ai-lab/Consistency_LLM) and perhaps giga-models like gpt4 (gpt5?) are already being upgraded to use this as I'm writing

thought this is still about token prediction. I actually foresee many more incremental improvements like this, we're in the "polishing" phase of LLMs, I don't think there'll soon be a ChatGPT breakthrough moment in the ChatGPT itself, just these incremental improvs + the expected gain from any energy efficiency improv + any improv from just adding more tflops

xnx mentioned John Carmack which seems to work on what I'm looking for, I'm really curious what this guy does