Re:Anyone got a contact at OpenAI. They have a spider problem
by Dr_Birdbrain on Thursday April 11, 2024 @05:58PM
(#40007261)
I bet they are training their internal models on the data. Bet the real reason they are not training open source models on that data is because of fears of knowledge distillation, somebody else could distill LLaMa into other models. Once the data is in one AI, it can be in any AIs. This problem is of course exacerbated by open source models, but even closed models are not immune, as the Alpaca paper showed.
[ Parent
| on HN ]
There are no comments on this comment yet.