News for hackers. Stuff that matters.
Re:Navier-Stokes – Tristan Buckmaster [pdf] by vlovich123 on Tuesday September 08, 2026 @08:43PM (#49619249)
I think you may be underestimating how difficult a text search over their data is. They may have to build new mechanisms to do this. And what you really want is also an attribution of how much of a contribution a given corpus made which is a much harder question to answer; a single appearance of a chat probably has very little impact on the inference performance at this time unless it’s been explicitly preferenced somehow
Re:Navier-Stokes – Tristan Buckmaster [pdf] by Catloafdev on Tuesday September 08, 2026 @09:15PM (#49619472)
I don't think anyone really cares about 'the measured impact the data had on the exact result' - a question which is fundamentally difficult to answer accurately in the first place - but rather whether the data was used in training at all - which as Tristan described, was extensive, beyond simply a 'single chat.'

Can you explain the difficulty in engineering a search apparatus over a corpus of text data? Actually searching through it may not be easy, sure, but it's work that's doable, and creating an index is relatively trivial.

Re:Navier-Stokes – Tristan Buckmaster [pdf] by JoshTriplett on Tuesday September 08, 2026 @09:37PM (#49619691)
> Can you explain the difficulty in engineering a search apparatus over a corpus of text data?

My guess: "If we ever imply that's possible, people might start asking questions about all the other work we've ripped off, so the official answer is that it's impossible".

Re:Navier-Stokes – Tristan Buckmaster [pdf] by dd8601fn on Tuesday September 08, 2026 @10:18PM (#49619999)
If they literally can’t audit training data for a given model, they shouldn’t be operating.
Re:Navier-Stokes – Tristan Buckmaster [pdf] by JumpCrisscross on Tuesday September 08, 2026 @11:54PM (#49620724)
They can operate. They shouldn’t be claiming credit for discovering anything.