Re:Google trained Bard on ChatGPT chats from ShareGPT
by iandanforth on Thursday March 30, 2023 @05:33PM
(#35379090)
It does. In general this is known as teacher-student training or knowledge distillation. It works better if you have access to the activations of the model but you can work with just outputs as well.
[ Parent
| on HN ]