News for hackers. Stuff that matters.
Re:How concerned should we be about Astra's recurrent archit... by buppermint on Thursday September 03, 2026 @10:28PM (#49559811)
CoT is both correlated and causal of the model's real computations, it's just imperfect. If you manually add "Let's wrap it up" in the CoT during generation, most LLMs will actually wrap it up (this is a commonly used trick in local LLM circles to get long-winded LLMs to stop reasoning). This wouldn't work if CoT text didn't affect the actual internal model logic.
Re:How concerned should we be about Astra's recurrent archit... by khalic on Friday September 04, 2026 @05:52AM (#49562481)
Why does injecting random text increase the precision then?