News for hackers. Stuff that matters.
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by vidarh on Monday May 25, 2026 @07:24PM (#48273054)
You'd think so. It seems like there are a lot of odd gaps like that.

I also have a favourite English language PhD thesis I ask every new model about that they still struggle to find even though there's a Wikipedia article about it that links a blog post I wrote about it.

Anyone who thinks they've exhausted even publicly crawlable resources should ask them about some obscure stuff.

Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by mistrial9 on Monday May 25, 2026 @10:57PM (#48274471)
you might be surprised if you take this approach.. give key words and phrases in small amounts, each sentence of a prompt building on a previous sentence. Take a an example that is not very hard, like Lewis Carrol Alice in Wonderland original text. Although a quick question might get things sort of wrong, or miss details, if you guide the LLM to a certain part of the story, then a certain set of characters in that part of the story, then a certain statement or dramatic moment with those characters in that part of the story, you might get very specific detail that is close to line-by-line accurate. On the other hand, if you ask a quick, ordinary question about the same part of the story without supplying context and character names, you get something equally vague. YMMV
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by vidarh on Tuesday May 26, 2026 @06:23AM (#48277649)
For the PhD thesis in question, I've actually tested a lot of requests about different parts of it, and both Claude and ChatGPT still draws a total blank if you don't let them do searches.
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by thatcat on Monday May 25, 2026 @11:15PM (#48274566)
the models don't retain their full training data set
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by vidarh on Tuesday May 26, 2026 @06:18AM (#48277609)
No, but they do retain enough that it is interesting what they fail to retain.