Re:Being confidently wrong is the only thing holding AI back
by Workaccount2 on Friday August 22, 2025 @11:27AM
(#44985782)
I'm sure somewhere in the current labs there are teams that are trying to figure out context pruning and compression.
In theory you should be able to get a multiplicative effect on context window size by consolidating context into it's most distilled form.
30,000 tokens of wheel spinning to get the model back on track consolidated to 500 tokens of "We tried A, and it didn't work because XYZ, so avoid A" and kept in recent context
In theory you should be able to get a multiplicative effect on context window size by consolidating context into it's most distilled form.
30,000 tokens of wheel spinning to get the model back on track consolidated to 500 tokens of "We tried A, and it didn't work because XYZ, so avoid A" and kept in recent context