Re:Ask HN: How are thinking efforts implemented?
by simianwords on Monday June 08, 2026 @03:09AM
(#48442170)
This seems correct but again I would like to think post training could have been also done by checking only the string in the last message sent.
I might be very very wrong though and LLMs disagree with me, insisting that cache is preserved and the system message doesn't have to change (even though it often contains effort level in context) if effort level changes across turns, and that all you have to do is tell the inference lib that parses think tags to early-close think tags that are too long.