Re:Google trained Bard on ChatGPT chats from ShareGPT
by j_maffe on Thursday March 30, 2023 @02:15PM
(#35376884)
How did you come about being "fairly positive" that GPT-4 is trained on other AI conversations?
Re:Google trained Bard on ChatGPT chats from ShareGPT
by TremendousJudge on Thursday March 30, 2023 @03:29PM
(#35377742)
Many AI conversations have been floating around internet forums since the original GPT was released. As OpenAI hasn't shared anything about its training set, to err on the side of caution I would assume that they didn't filter these conversations out. If they aren't even marked as such, it may not even be possible to do. I think it would be very hard to prove that no AI conversations are included in the training set, even if it wasn't secret.
I really don’t understand this angle. In fact, I am fairly positive that the training set for GPT-4 contains many thousands of conversations with AI agents not developed by OpenAI.
Do AI companies need to manually sift through the corpus and scrub webpages that contain competitor LLM output?
(“Yes” is an acceptable answer to this, but then it applies to OpenAI’s currently existing models just as much as to Bard)