News for hackers. Stuff that matters.
Re:Google trained Bard on ChatGPT chats from ShareGPT by iandanforth on Thursday March 30, 2023 @05:33PM (#35379090)
It does. In general this is known as teacher-student training or knowledge distillation. It works better if you have access to the activations of the model but you can work with just outputs as well.
Re:Google trained Bard on ChatGPT chats from ShareGPT by ithkuil on Friday March 31, 2023 @01:36AM (#35383043)
Does it work even if you don't control the inputs?