News for hackers. Stuff that matters.
Re:What makes collapse inevitable and imminent by germinalphrase on Wednesday May 04, 2022 @11:16AM (#31261664)
Three years? That’s a stunningly optimistic (pessimistic?) timeline…
Re:What makes collapse inevitable and imminent by FeepingCreature on Wednesday May 04, 2022 @11:20AM (#31261737)
What can I say, PaLM is scary.
Re:What makes collapse inevitable and imminent by NoGravitas on Wednesday May 04, 2022 @01:03PM (#31263099)
The hand-picked examples are pretty scary, but I'm also reasonably sure that AGI is not going to come (directly) from LLMs no matter how big they get.

Reasoning: https://medium.com/@emilymenonbender/on-nyt-magazine-on-ai-r...

Re:What makes collapse inevitable and imminent by FeepingCreature on Wednesday May 04, 2022 @09:56PM (#31268457)
Seems too focused on the NYT article? I don't think this because the NYT said so, I think this because PaLM's chains-of-thought approach seems to match how my own brain works. I think LMs have huge intelligence overhang atm that is hidden by the way they are forced to respond. If we figure out how to train LMs with propagation through hidden chains of thought, we'll see a huge jump in capability, and also this is the obvious next step that the industry will aim for.
Re:What makes collapse inevitable and imminent by zmgsabst on Wednesday May 04, 2022 @11:22AM (#31261762)
I’m betting 2025-2030 as well.

We have quantum AI math developed and photonic accelerators are currently in development. The moment those work reliably, machine learning will hit an exponential curve — particularly since those photonic circuits are already partially designed by AI.

The feedback loop of quantum-accelerated AI refining its own hardware is one breakthrough away.

Re:What makes collapse inevitable and imminent by whimsicalism on Wednesday May 04, 2022 @11:39AM (#31262008)
Stop reading so much popsci, it is bad for thought.
Re:What makes collapse inevitable and imminent by more_corn on Wednesday May 04, 2022 @01:07PM (#31263150)
This is an interesting criticism. I grew up on wired magazine and sci-fi. Even then I recognized the dangers of shallow knowledge and maybe I can’t avoid it even now. But I’m actively working with GPT3 and I must say it is startling. I’d say we’re a few years from automating most knowledge tasks (I created a tool that I chose not to release because it was too powerful). We could be a decade from general purpose artificial intelligence (or it might not be possible at all. For a fun thought experiment ask GPT3 if it is truly conscious). The answer it gave me was surprisingly coherent wise and useful. From there (AGI) we could be minutes away from artificial super intelligence. That starts to look a bit like a point pst which standard prediction breaks down. But like you say, pop sci might be hindering rational thinking on this score.
Re:What makes collapse inevitable and imminent by whimsicalism on Wednesday May 04, 2022 @01:15PM (#31263261)
I used to work in physics, which seems to attract a lot of people with shallow knowledge, and ML seems to be going in a similar direction.

To be clear, I'm actually quite bullish on AI (well, bullish on it ultimately happening, not necessarily on how it will impact humanity). I was mostly reacting to the timeline for photonic quantum computing rather than on ML advancement, actually.

Language modeling is extremely impressive. I've been saying since 2017 that modeling language is basically modeling the world/intelligence, but at the time most people did not seem to believe that. People still don't really seem to believe it, but I think the smarter among us are beginning to now that they see GPT-X & PaLM. I think there is still a substantial gap from "good language model" to "embodied agent taking actions in the world" that we have not bridged and will be potentially pretty hard to, more than mere "minutes."

Re:What makes collapse inevitable and imminent by zmgsabst on Wednesday May 04, 2022 @01:32PM (#31263459)
> will be potentially pretty hard to, more than mere "minutes."

This makes it sound like you’re arguing against something no one said — which makes it a weird thing to quote.

Re:What makes collapse inevitable and imminent by whimsicalism on Wednesday May 04, 2022 @01:34PM (#31263491)
A quote from the GP

> The answer it gave me was surprisingly coherent wise and useful. From there (AGI) we could be minutes away from artificial super intelligence

What am I missing? I assumed of course that they didn't mean literal minutes but more metaphorically, but my reply was also using it in the metaphoric sense - it could be a potentially heavy lift to go from point A to point B.

e: I guess I am missing that they are conflating GPT with AGI and saying it will be minutes from AGI to artificial super intelligence in the literal sense. That, I actually do agree with, but I don't think GPT-X or PaLM or LMs in general qualify as such.

Re:What makes collapse inevitable and imminent by zmgsabst on Wednesday May 04, 2022 @01:43PM (#31263574)
I read it in a different way, where we’d go from “plays chess like a bad human” to “plays chess superhumanly”, applied to general knowledge synthesis tasks — something that would be a rapid change once it was able to synthesize general knowledge answers.

Upon reflection, my comment was too critical for having a different read than you did.

Re:What makes collapse inevitable and imminent by zmgsabst on Wednesday May 04, 2022 @12:44PM (#31262856)
I’m sorry that you’re ignorant.

Microsoft QuArC has published a number of papers on QAI, and I both work on photonics and discuss with other companies who do the accelerators being developed. Accelerating AI with photonics is an active area of development.

I think you’re projecting that your knowledge of this is only based on pop-sci.

Re:What makes collapse inevitable and imminent by whimsicalism on Wednesday May 04, 2022 @12:53PM (#31262969)
There are a ton of unsolved problems in both ML and quantum computing with photonics.

We are so far away from being able to do this with photonic quantum computers that I am really skeptical that you actively work in this field.

FWIW, I know quite a lot of people involved in AMO physics (which involves related techniques) and work in ML myself.

2025-2030 is way too soon for these things to come to fruition.

Re:What makes collapse inevitable and imminent by zmgsabst on Wednesday May 04, 2022 @12:57PM (#31263020)
I guess you know less talented people then.

We’re not more than a single breakthrough from being able to make photonic accelerators — and there’s already worked out algorithms to accelerate ML once those circuits are available.

I’m confident in 2025-2030.

Re:What makes collapse inevitable and imminent by whimsicalism on Wednesday May 04, 2022 @01:02PM (#31263090)
This is one of the ~top two universities in the country for AMO research, so I don't think so.

Such false bravado, not going to keep replying.

Re:What makes collapse inevitable and imminent by zmgsabst on Wednesday May 04, 2022 @01:04PM (#31263115)
> Such false bravado, not going to keep replying.

Yawn — you’re the one who came in with ad hominems and trying to tell other people what they work on, lol

I’m sorry your friends are ignorant and you don’t know what I do.