Re:Electronic Structure of LK-99
by feoren on Wednesday August 02, 2023 @03:33PM
(#36975986)
> This doesn't seem like a convincing argument that current ML techniques are tapped out.
Absolutely right, I wasn't very clear -- I don't believe "current ML techniques" are tapped out. I do believe that we're not going to see a GPT5 for several more years, and a GPT6 for another decade+ (or if we do, it will be branding, not anything significantly better). We're at the top of the sigmoid curve for the benefit of just making bigger and bigger LLMs.
Absolutely right, I wasn't very clear -- I don't believe "current ML techniques" are tapped out. I do believe that we're not going to see a GPT5 for several more years, and a GPT6 for another decade+ (or if we do, it will be branding, not anything significantly better). We're at the top of the sigmoid curve for the benefit of just making bigger and bigger LLMs.