News for hackers. Stuff that matters.
Re:Who needs Git when you have 1M context windows? by kristjansson on Tuesday October 07, 2025 @10:52AM (#45503825)
If it’s in the context window … it’s sitting around as plain text. I guess asking is easier than scrollback?
Re:Who needs Git when you have 1M context windows? by rfw300 on Tuesday October 07, 2025 @01:19PM (#45505951)
Indeed. OP, nothing is "in" an LLM's context window at rest. The old version of your file is just cached in whatever file stores your IDE's chat logs, and this is an expensive way of retrieving what's already on your computer.
Re:Who needs Git when you have 1M context windows? by kristjansson on Tuesday October 07, 2025 @02:06PM (#45506571)
I mean there is the chance it's on someone else's computer ^W^W^W^ the cloud, and his provider of choice doesn't offer easy access to deep scrollback ... which means this is only inefficient, not inefficient and pointless.
Re:Who needs Git when you have 1M context windows? by red2awn on Tuesday October 07, 2025 @03:34PM (#45507746)
Technically it doesn't have to be since that part of the context window would have been in the KV cache and the inference provider could have thrown away the textual input.
Re:Who needs Git when you have 1M context windows? by Cr8 on Tuesday October 07, 2025 @05:01PM (#45508825)
possible - but KV caches are generally _much_ bigger than the source text and can be reproduced from the source text so it wouldn't make a lot of sense to throw it out