News for hackers. Stuff that matters.

A comment on After 118 days, GPT Unicorn has produced a unicorn. Parent comment

Re:After 118 days, GPT Unicorn has produced a unicorn by luc4sdreyer on Thursday August 10, 2023 @06:39AM (#37074331)
I'm not aware of anything concrete by OpenAI, but others have offered possible explanations.

One idea is that the cause is batched inference in sparse MoE (mixture of experts) models.

https://152334h.github.io/blog/non-determinism-in-gpt-4/

HN discussion: https://news.ycombinator.com/item?id=37006224

[ Parent | on HN ]
Re:After 118 days, GPT Unicorn has produced a unicorn by davrosthedalek on Thursday August 10, 2023 @07:32AM (#37074757)
So in some sense the spectre attack for AI?
[ Parent | on HN ]
Re:After 118 days, GPT Unicorn has produced a unicorn by awestroke on Thursday August 10, 2023 @10:08AM (#37076361)
No
[ Parent | on HN ]