News for hackers. Stuff that matters.
Re:Who needs Git when you have 1M context windows? by red2awn on Tuesday October 07, 2025 @03:34PM (#45507746)
Technically it doesn't have to be since that part of the context window would have been in the KV cache and the inference provider could have thrown away the textual input.
Re:Who needs Git when you have 1M context windows? by Cr8 on Tuesday October 07, 2025 @05:01PM (#45508825)
possible - but KV caches are generally _much_ bigger than the source text and can be reproduced from the source text so it wouldn't make a lot of sense to throw it out