News for hackers. Stuff that matters.
Re:DeepScaleR: Surpassing O1-Preview with a 1.5B Model by Sc... by manmal on Tuesday February 11, 2025 @04:53PM (#43018833)
I guess one could just watch the token output stream and replace solvable expressions with calculated results, continuing with the replaced result. Kind of like the LLM producing a template, to be filled on the fly.

Some models now do something like this for enforcing longer reasoning processes - they replace </think> with „Wait“.

There are no comments on this comment yet.