Re:FTC investigating ChatGPT over potential consumer harm
by arthurcolle on Thursday July 13, 2023 @10:18PM
(#36718676)
Yep. Especially with geohot leaks and torrent activity at an all time high - OpenAI looks cooked
[ Parent
| on HN ]
Re:FTC investigating ChatGPT over potential consumer harm
by biofunsf on Thursday July 13, 2023 @10:18PM
(#36718680)
What are the geohot leaks?
Re:FTC investigating ChatGPT over potential consumer harm
by bodecker on Thursday July 13, 2023 @10:41PM
(#36718820)
I assume comments like these, "GPT-4: 8 x 220B experts trained with different data/task distributions and 16-iter inference."
https://twitter.com/soumithchintala/status/16712671501017210... https://archive.li/rfFlW
I'm not sure the most canonical paper on mixture of experts but here's one possible:
Re:FTC investigating ChatGPT over potential consumer harm
by arthurcolle on Friday July 14, 2023 @02:15AM
(#36720094)
I think when ppl refer to MoE they are referring generally to the Google GLaM paper actually
Re:FTC investigating ChatGPT over potential consumer harm
by ZunarJ5 on Thursday July 13, 2023 @10:44PM
(#36718841)
https://the-decoder.com/gpt-4-architecture-datasets-costs-an...
Not op, but this is where a cheeky google got me.
Re:FTC investigating ChatGPT over potential consumer harm
by 1vuio0pswjnm7 on Thursday July 13, 2023 @10:49PM
(#36718878)
"The idea is nearly 30 years old and has been used for large language models before, such as Google's Switch Transformer."
Innovation! :)