Re:What GPT-OSS leaks about OpenAI's training data
by NoahZuniga on Sunday October 05, 2025 @05:24PM
(#45485422)
This article says that "GPT-5 was trained on phrases from adult websites". However, this is misleading as the only thing that was shown is that GPT-5 was trained on phrases that also occur on adult websites, with some speculation of the source of the training data container such adult phrases being GitHub.
[ Parent
| on HN ]
Re:What GPT-OSS leaks about OpenAI's training data
by tymscar on Sunday October 05, 2025 @08:33PM
(#45486528)
This is addressed at the end of the blogpost
Re:What GPT-OSS leaks about OpenAI's training data
by a_victorp on Sunday October 05, 2025 @09:49PM
(#45486905)
It is not
Re:What GPT-OSS leaks about OpenAI's training data
by rahulstein on Monday October 06, 2025 @01:49AM
(#45488030)
It is - in the link to the MIT Technology Review article
Re:What GPT-OSS leaks about OpenAI's training data
by jimmydoe on Sunday October 05, 2025 @11:08PM
(#45487304)
Chinese adult site ads are everywhere in repackaged free and pirate content, which are distributed thru sites including but not limited to github, shadow libraries and youtube.
for same reason, whisper some blank audio will output those ads.
Re:What GPT-OSS leaks about OpenAI's training data
by breakingcups on Monday October 06, 2025 @05:15AM
(#45489371)
Specifically, because some pirates will put advertisements for other illicit services at the beginning or end of movies and tv shows in its subtitle data where there's a suitable gap. Usually those gaps have silence.
Companies incorporating subtitle data as transcription source of truth training data will thus train their models to output facsimiles of these messages whenever they're encountering prolonged stretches of silence.
Re:What GPT-OSS leaks about OpenAI's training data
by wongarsu on Monday October 06, 2025 @11:13AM
(#45492299)
I think that is what the article is saying, just with a very misleading phrasing. The phrases are from adult websites, and likely entered the training data via Github (lists for content blockers etc). Just like "to be or not to be" is from Hamlet, but you just read it on HN. At no point does the article actually say that adult websites were in the training data