News for hackers. Stuff that matters.
Re:AI will divide the best from the rest by cybrox on Friday February 14, 2025 @10:23AM (#43049245)
I recommend you look at pictures of how people in the 60s thought the 2000s would be like.
Re:AI will divide the best from the rest by Hizonner on Friday February 14, 2025 @10:30AM (#43049323)
I was there.

You know the most far-out thing I remember in sci-fi from when I was a kid? Some guy was on his way to start in the Space Patrol Academy or whatever, and his phone rang. Like this 18 year old kid was gonna be carrying a phone around with him everywhere. I mean, sure, nuclear rockets, you can see how to do that, but some kind of nationwide radiophone system?

Anyway, 2 to 20 is only about a 90 percent confidence interval. It could get stalled by power or space demands.

Re:AI will divide the best from the rest by oofoe on Friday February 14, 2025 @11:48AM (#43050302)
Hey! I understood that reference! That was something that stayed with me long after the "big science" (atomic rockets, Venusians, etc.) of Space Cadet. It was something that everybody had, and then it started to come true, which was amazing.

Unfortunately, it's getting to be where the part where he just mailed the phone back to his family is the more science-fictional scenario...

Re:AI will divide the best from the rest by dsr_ on Friday February 14, 2025 @10:45AM (#43049553)
Heinlein, _Space Cadet_. Published in 1948, so likely on your school library shelves in 1960 -- I'm sure I didn't read it until 1980, at earliest.
Re:AI will divide the best from the rest by Hizonner on Friday February 14, 2025 @10:48AM (#43049596)
Yes, that'd be it. I may not actually have read it until the early 1970s.
Re:AI will divide the best from the rest by balls187 on Friday February 14, 2025 @10:38AM (#43049451)
Not there in the 60’s, but sci-fi showing people interacting with touch and using flat tablet.
Re:AI will divide the best from the rest by lm28469 on Friday February 14, 2025 @10:36AM (#43049416)
I was there when musk said we'd have fully self driving tesla in 2 year, in 2021. I was there when he said we'll be back on mars in 2025, I was there when uber said they will buy every single car tesla can manufacture by the year 2020.

It's all bullshit, how can people fall from it, and keep falling for it over and over and over ?

Re:AI will divide the best from the rest by Hizonner on Friday February 14, 2025 @10:38AM (#43049452)
Know what? I believed none of those things, because they were obvious stupid bullshit.

It turns out you have to actually think.

Re:AI will divide the best from the rest by lm28469 on Friday February 14, 2025 @10:52AM (#43049653)
I think you're mistaking _thinking_ for _believing_ and _wishful thinking_ sprinkled with a bit of _wild guessing_
Re:AI will divide the best from the rest by Hizonner on Friday February 14, 2025 @10:58AM (#43049722)
I assure you that I don't wish for some of the outcomes I think are reasonably likely.

... and in general I think you're mistaking me for somebody who's spent a lot less time on these issues.

Re:AI will divide the best from the rest by lm28469 on Friday February 14, 2025 @11:08AM (#43049851)
The line went up a bit faster in the last 5 years so the line must continue to go up exponentially ? That's about the only "logical" way to get from LLMs to AGI.

Replacing "the best of us" in 2 years... come on, even Altman isn't getting that high on his own supply

> I think you're mistaking me for somebody who's spent a lot less time on these issues.

Unless you're God himself I doubt you can predict the future of events that never happened in the past with any kind of accuracy. There have been thousands of people like you with prophecies of AGI in the next "10 years" since computers are a thing.

Re:AI will divide the best from the rest by Hizonner on Friday February 14, 2025 @11:19AM (#43049976)
What? LLMs aren't going to be AGI, or at least I'd be really surprised if anything that was basically an LLM got to AGI. LLMs may be components of AGI, but even a "reasoning" LLM isn't going to be AGI. Not even a multimodal model. Probably not even with a planning scaffold. And even if you can call the core of your first AGI an LLM, I really doubt it'll recognizably be a transformer.

What gets you to AGI is dumping, I don't know, maybe 100 billion dollars of investment into trying out the kinds of not-particularly-LLM-like architectural innovations that people are already playing with on top of deep learning generally, plus the hybrid architectures that will inevitably pop up.

We are probably 2 or 3 breakthroughs away from AGI. When you have that much attention on a topic, especially when it's aided by what we already have, you can reasonably expect to get them relatively soon. Then there are the scaling issues.

Re:AI will divide the best from the rest by lm28469 on Friday February 14, 2025 @05:27PM (#43053798)
> We are probably 2 or 3 breakthroughs away from AGI.

Based on what exactly?

We're also "2 or 3 breakthrough away" from anything, fusion, space exploration, room temp superconductivity, immortality...

Pick your sci-fi, it's right there, a tiny bit out of reach, but believe just a little bit more and it'll be yours

Re:AI will divide the best from the rest by Hizonner on Friday February 14, 2025 @07:57PM (#43054762)
> Based on what exactly?

Missing capabilities that probably won't be achievable purely with LLMs or similar:

+ Long-term learning (not just context hacks) from live experience, including deciding what it needs to learn and choosing what to do or ingest to achieve that. This basically eliminates the training-versus-inference distinction.

+ Critical evaluation of incoming data during ingestion, in all learning phases, or at least after very early pretraining.

+ Better critical evaluation of its own ideas (although "reasoning" is a step toward this one).

+ A decent predictive understanding of the physical world, which probably demands embodied robotics with a variety of sensory and motor modes (probably plus "pure digital data" modes like existing models have).

+ Complex, coherent, flexible and adaptable long-term planning and execution at a variety of time scales and levels of abstraction.

+ Generally better attention control in the "nontechnical" sense of attention.

+ Self-improvement, including both architectural innovation and performance optimization (probably falls out of the above).

+ Scalability and performance. Even if you build significantly superhuman AGI, it doesn't change the world much unless you can run a lot of it.

I would expect most architectural breakthroughs to help with more than one of those, and a really good architectural breakthrough to help with most of them all at the same time. So I'm guessing two or three breakthroughs. And I don't mean "breakthroughs" in the sense of, say, relativity. Just significant new architectural insights, on the order of transformers or maybe deep learning generally.

The one I'm least sure will be solved soon is the scaling one. If it turns out that the only way to scale up enough is to completely reinvent computers, perhaps out of biotech or nanotech or whatever, it's going to take a long time. On the other hand, if you do get even remotely decent scaling, and you have even the clunkiest form of generalizable self-improvement, you're probably basically done.

> We're also "2 or 3 breakthrough away" from anything

That whole line of argument is invalid from the start, since it has nothing to do with the actual subject under discussion. But I'll take the bait.

We are not, in fact, 2 or 3 breakthroughs away from any of those. Nor is there remotely the level of investment in any of those that AI and ML are getting, which means any breakthroughs we do need are going to take longer.

> fusion

Probably one breakthrough needed... but with or without that, fusion energy may not be feasible at all, at least not at a price point that makes it competitive with the energy sources we already have.

If feasible, fusion will need a crapton of incremental, interdisciplinary engineering and testing on top of the breakthrough. That kind of grind work is harder and slower than breakthroughs, because there are so many conceptually unrelated, but interacting things to get right before you have a power plant.

Then you have to get the permits.

Fusion plants will probably not be on the grid in 20 years. If they are, it'll be because of some radical changes beyond the borders of energy generation.

> space exploration

There's space exploration going on now, and has been for decades.

If you mean long-term, self-sustaining space living, there are a ton of engineering problems to grind through, but I don't know if you need even one technical breakthrough. The bigger problems are that--

+ You have to do it on an immense, prohibitively expensive scale for it to be viable at all.

+ The social and political problems are enormous.

+ In the end, space just plain sucks as a place for humans to live anyhow.

You might be able to fix that last one with bioengineering capabilities on the order of the ones you'd need for immortality. Which is a long-term project.

Personally I think it's not worth the trouble.

> immortality

You might eventually be able to get to (quasi-)immortality, but it's going to require a ridiculous number of diverse interventions in extremely complex systems... plus the tools to actually do those interventions. Which depend on understanding the systems. Which requires more tools.

You need to do massive amounts of grunt work and probably make a lot of breakthroughs. Nobody who has any real understanding of the problem has ever suggested that it's two or three breakthroughs away. And you might need superhuman AGIs first to understand the total effect of all the hackery you were doing.

Moderately better than human AGI can probably speed up any of those, but probably not as far as some people think. Unless you're a superintelligence, you have to put in lab time for all of that stuff. You might have to do that even if you are a superintelligence. And superintelligence feasibility, capabilities and timelines are harder to guess than simple AGI.

Re:AI will divide the best from the rest by BoiledCabbage on Friday February 14, 2025 @09:08PM (#43055179)
> It's all bullshit, how can people fall from it, and keep falling for it over and over and over ?

I mean what do they all have in common? Elon Musk.

Other statements about the future while not perfect, fare much better.

Re:AI will divide the best from the rest by csallen on Friday February 14, 2025 @10:24AM (#43049258)
Every situation is different, and thorough thinking requires taking those differences into account, rather than using oversimplified heuristics.
Re:AI will divide the best from the rest by beezlewax on Friday February 14, 2025 @10:26AM (#43049286)
I'm not sure which side of this two-sided argument you are trying to support with this comment.
Re:AI will divide the best from the rest by csallen on Friday February 14, 2025 @10:28AM (#43049307)
I'm against the idea that past overestimates of technological progress imply that CurrentTechPredictionX must also be an overestimate. It's a lazy way of thinking that fails to actually look at any specific details of either situation.
Re:AI will divide the best from the rest by cybrox on Friday February 14, 2025 @10:36AM (#43049412)
I'm not implying the current prediction >must< also be an overestimate. I'm saying be careful when adjusting your expectations based on current rapid momentum.
Re:AI will divide the best from the rest by bee_rider on Friday February 14, 2025 @10:40AM (#43049477)
IMO it is better not to assume a comment is trying to support one of two sides of an argument. For example, it might be critiquing the general way the argument has been framed (where the line’s been drawn between the two sides), or the method of making the argument (if everyone is sitting around looking at some obviously incomplete data and trying to tweak it to push their point, it is worth pointing out that whatever conclusion the group comes to is probably meaningless).

Or it could just the a bit vague and hard to interpret.