News for hackers. Stuff that matters.
Re:OpenAI O3-Mini by acka on Sunday February 02, 2025 @11:28AM (#42909632)
Repetition of topics and subtopics is by far the most important part, reinforcing attention on the topic at hand even if the text in the chunk appears unrelated to the topic when viewed in isolation. Keeping the indentation is mostly about convenience - not having to postprocess the YAML beyond repeating higher level keys.

Keeping the indentation is also important because it is an implicit and repeated indication of the nesting level of the content that follows (LLMs have trouble with balancing nested parentheses as the sibling comment to yours explains) and LLMs have been exposed to large amounts of text where indentation matters (such as Python code and lists of bullet points) during training, so they have learned to handle this well.

There are no comments on this comment yet.