That is really not true anymore unless there will be a new technology that can do much better than silicon electronics. Doesn't mean that were safe, but it's not that clear.
The end of Moore's Law is here (for now) even with multicores and everything else, by the way. That you can get more compute by throwing more resources at the problem doesn't really count. The big deal about Moore's Law was that it was free. The 3D stuff, clusters, etc, can increase the number of transistors... but it's gonna cost proportionally more in fabrication and energy when running.
Good thing that the number of neurons in our brains are so many orders of magnitude larger than this that it doesn't matter.
I think what you're getting at is that in the next few years we're going to have AGI, which will eventually cause societal collapse. Under that assumption, while all of the AGI arguments are pretty poor, computing power increases over time is one of the weakest. It's going to take so much more than just computing power to get us close to AGI, it's going to take a lot more than LLMs, and it's possible to poison models with specially created data, so I'm not worried; I don't have shivers. What gives me more shivers is that there are people that seriously believe the hype to the degree that they believe the current technology, just a bit improved, will lead to the end of our current life as we know it.
It is hardly impossible there are remote white color workers at 30 right now who have to get a 6am-3pm/3pm-11pm/11pm-6am factory job at 50.
It is such a miserable thought I think the idea of societal collapse is more comforting.
I must have watched the movie Terminator 2 more than 50 times. I know the AI apocalypse very well. Don’t worry about it. If the day comes, we’ll figure it out.
Those 16 billion neurons in the cortex form over 140 TRILLION connections through synapes. Those are both computing elements as well as memory.
There's no comparison, not even close. As a bonus we don't each require a giant warehouse to house us, we don't require a vast supply of water, nor do we require a personal dedicated power plant.
For how many years has this been the trend?
[1] I imagine the same is true for o3. We simply don’t know how to make an AI that actually understands what numbers are in the way that toddlers and pigeons do.
If you think this is all BS and you will be always smarter than any machine, realize that raw computing power grows by 10^6 every ~25 years. AI seems to follow the same growth.
If you think you are safe, read what Geoffrey Hinton, one of the fathers of ML, said about 10-20% chance of AI leading to human extinction in 30 years. Or read about Sam Altman building his bunker in New Zealand while espousing AI utopia.
If this doesn't give you shivers, enjoy your blissful ignorance.