News for hackers. Stuff that matters.
Re:FTC investigating ChatGPT over potential consumer harm by arthurcolle on Thursday July 13, 2023 @10:18PM (#36718676)
Yep. Especially with geohot leaks and torrent activity at an all time high - OpenAI looks cooked
Re:FTC investigating ChatGPT over potential consumer harm by biofunsf on Thursday July 13, 2023 @10:18PM (#36718680)
What are the geohot leaks?
Re:FTC investigating ChatGPT over potential consumer harm by bodecker on Thursday July 13, 2023 @10:41PM (#36718820)
I assume comments like these, "GPT-4: 8 x 220B experts trained with different data/task distributions and 16-iter inference."

https://twitter.com/soumithchintala/status/16712671501017210... https://archive.li/rfFlW

I'm not sure the most canonical paper on mixture of experts but here's one possible:

https://arxiv.org/pdf/1701.06538.pdf

Re:FTC investigating ChatGPT over potential consumer harm by arthurcolle on Friday July 14, 2023 @02:15AM (#36720094)
I think when ppl refer to MoE they are referring generally to the Google GLaM paper actually
Re:FTC investigating ChatGPT over potential consumer harm by ZunarJ5 on Thursday July 13, 2023 @10:44PM (#36718841)
https://the-decoder.com/gpt-4-architecture-datasets-costs-an...

Not op, but this is where a cheeky google got me.

Re:FTC investigating ChatGPT over potential consumer harm by 1vuio0pswjnm7 on Thursday July 13, 2023 @10:49PM (#36718878)
"The idea is nearly 30 years old and has been used for large language models before, such as Google's Switch Transformer."

Innovation! :)

Re:FTC investigating ChatGPT over potential consumer harm by ta988 on Thursday July 13, 2023 @10:49PM (#36718880)
George Hotz (pseudo geohot) in his recent interview with Lex Fridman gave some info on the probable structure of gpt4.
Re:FTC investigating ChatGPT over potential consumer harm by flangola7 on Thursday July 13, 2023 @10:53PM (#36718912)
Torrent activity?