News for hackers. Stuff that matters.
Re:Context Sculpting by theowaway213456 on Saturday June 06, 2026 @10:01PM (#48431022)
Not a single mention of prompt caching in this article, which is a massive benefit of append-only context.
Re:Context Sculpting by unholiness on Saturday June 06, 2026 @11:00PM (#48431364)
If it were, I can in theory see situations where improving content cleanliness is worth blowing away the KV cache.

But I absolutely can't see how feeding the entire context into a more expensive model multiple times per task, just to propose context edits that might indirectly help, could ever be worthwhile.

Re:Context Sculpting by jauntywundrkind on Saturday June 06, 2026 @11:56PM (#48431624)
Cost wise yes, but in terms of getting the correct best work done? Meh, not helpful!

I think more what's missing here is the comparison of different tries, from the same head. And there prompt caching does help!