Didn’t we already achieve super intelligence?
That’s what I am responding to.
What's happening today is that anyone and everyone can have access to superintelligence. Anyone with access to an LLM effectively is, simultaneously, a world-class diagnostician, engineer, architect, musician, mathematician... you get the point. This will necessarily lead to a post-scarcity society, since everyone knows everything and will be capable of producing anything.
I wish I shared this optimism, unfortunately that upper echelon of society is the one which currently controls the superintelligence. Everyone may have access to it, but they own it.
Still, as of now, while I use AI for everything I do (mostly Claude but also ChatGPT), I don't use any open weight models (probably more of a mental block at this point), but I do see them as a necessary counterweight to this potential power imbalance.
It’s hard to take you AI-hype men seriously when you are this ravingly delusional.
A post-scarcity society is not possible without first wiping out society. If everyone has everything then everyone has nothing. And of course, natural resources are actually limited, and those power LLMs.
A post-scarcity society requires MATERIAL abundance in the hands of everyone.
All the material is controlled by ~100 mentally ill people who would rather kill us all than share.
The tech industry cultivated that reputation though. People were just acting rationally by being more skeptical of even larger claims than they were making before.
Well, the amount of money and resources it took to get here is a reason. I don't think the resources exist for another order of magnitude increase, given the strain on our economy and society we're already under due to AI.
[0] https://epoch.ai/publications/the-plunging-price-of-thought
Just the other day a model helped me root an old android tablet. Will that still work in 5 years? I don't really have great confidence.
The Trump thing is a insane newspeak attempt to forcibly replace the use of "artificial intelligence" with "super intelligence" in a general sense. It is ridiculous, obviously, but the best thing we can do is to continue using "superintelligence" in its original, narrower sense.
[1] https://en.wikipedia.org/wiki/Superintelligence:_Paths,_Dang...
That might require continuous learning without verifiable rewards. RL models might help humans join the dots faster, but we don't know how many years that will take.
But it also might not, which is the scary part.
Seems the CRUD app may not need writing soon, and the car may charge itself.
LLM-assisted research is proving to be useful, rewarding and joyful, but we should not treat LLMs as a perfect machine, incapable of making mistakes. Especially in such massive proofs as this one.
I won't say that it "doesn't count". I will simply ask for staying rational.
If you watch movies or read fiction, we’ve expected for years that life in the future will be very different.
lmfao, buddy
This is the term you use when you intentionally want to align yourself with the Trump regime.
Likewise, this is the term you use when you want to align yourself with
We can start talking when we can train these things without having to beat on its head a million times in a million different ways to teach it one little thing...
If you do want to see something done about it and this isn't just another prediction or a vague warning, more power to you, but otherwise, I'll wait and see
No one said that. If you look at e.g. the Metaculus predictions, you can see AGI has been hovering around 2027-2030 for 5 years.
https://www.metaculus.com/questions/3479/date-weakly-general...
https://www.metaculus.com/questions/5121/date-of-artificial-...
If you zoom into any curve it tends to look linear. I think that is what you keep doing. But if you look at the world as how it was 5 years ago compared to now, there is no denying there is a massive change.
I am not pushing you to do anything. I am not asking you to "believe" or anything. But we are, in my and many other's estimations, in the midst of what was called the "singularity" in AI communities, although it isn't a true mathematical singularity, it is just a strong acceleration.
Fantastic, I'll remain at my previous position then, I'll believe it when I see it.
(As a very off-topic sidenote, the term singularity never made much sense to me. I believe it was originally used to describe the sci-fi concept of a human gestalt consciousness, but has shifted to being about super-intelligence which doesn't seem to have much to do with "singular" at all. But, language changes I suppose)
Huh? The term itself was introduced by Vernor Vinge to refer to the accelerated rate of change as a result of the introduction of super-intelligence. He said it would make things harder to predict in the future. It is part of this article:
https://en.wikipedia.org/wiki/Technological_singularity
It was never about "consciousness".
Curious what you need to see. Some physical impact to your way of life? Are you not able to extrapolate the obvious?
One such coalescion is: https://pauseai.info/
If someone were to come to me with something like this as their reasoning, I wouldn't feel the same way.
Exponential progress has been the repeated truth, mirroring predictions.
The result of exponential progress into 2027 is a complete de-mapping of what we know to be human, whatever that may look like exactly at this point is hard to say.
We need your help, and everyone's help, to put a pause on this such that we are able to ground and find a healthy way forward together for as many human beings as possible.
Please subscribe to that newsletter and consider joining us at a protest if feasible.
I understand that many people don't think it will happen, but I can't really understand the position that you think there is a real chance superintelligence happens, but aren't concerned about it and are happy to wait passively to find out.
If you care about humanity at all it should be concerning because superint (if real) could be heavily destructive to our society.
Is there? Yes, LLMs are integrated into a bunch of software, but practically speaking life is pretty much the same as it was five years ago.
I should have restricted it to the fields that have been impacted and have seen significant adoption: art for commercial purposes, writing, software development and mathematics primarily, and those adjacent to those fields. It is true that most other fields have not really felt that many effects.
I can't think of anyone except maybe Elon Musk.
There might be, but I'm curious about the volume (I suspect very low).
Okay. If your point isn't that people believed superintelligence was months to a year away years ago, what is your point?
My point was that I'd rather wait for proof than accept a prediction.
People were talking about superintelligence in 2021, but "by the end of the decade", not "next year".
As long as I get to keep my house...
This technology won't be available to the broad public in the scale that it's available to a select group. If it can only be deployed to a limited amount, to most it remains a magical inaccessible box. And that majority should naturally be incentivized to look for cheaper alternatives, and to "keep moving the goalposts", or in simpler terms, looking where they can provide value, of which there is plenty!
Consider just how much more inference capability one can buy per dollar spent today as compared to a year ago. I can get tasks done quickly for essentially no cost that, early last year, might have cost a frontier lab hundreds or thousands of dollars and would have been unavailable to the general public.
In my mind, the bigger unknown is whether actual profitable use cases will show up quickly enough to justify all the (enormous) investment made in the technology.
It's OK to admit we just don't know when or where it'll srop
Also virtually no one argues llms will go away, but a lot of people argue the current companies might, it's completely different.
You need retards on both sides of the spectrum for a balanced society
These terms mean different things to different people. What are the particular implications of this that you're suggesting are imminent?
There are very solid arguments about why excellence at proving mathematical theorems does not necessarily imply general intelligence of the sort that people associate with ASI.
You have the input (hypothesis), the output (true/false) and the lean kernel. There exists some path from the input to one of the outputs, you "just" need to find it. You use AI to search this exponential space, occasionally prunning ideas that are dead ends, and throw as many agents as possible to scale it up.
I note that the dazzling events that have happened have all been in coding, cybersec, and math, that is, domains where the correctness of the work can be verified entirely inside the computer. It is unclear whether further progress along these lines leads to crazy scientific breakthroughs too, which is something people are taking as a given when it comes to superintelligence.
For computers though, symbolic manipulation is something they are extremely good at, and something that clearly scales well will memory and compute. Therefore I would argue that calling a computer superintelligent would, in analogy to do what we do with humans, require computers to rise above things that are extremely difficult for them. It is of course hard to judge what would be hard for them not being them for the introspection, but it seems the ability to operate outside the realm of symbolic or numeric manipulation would be precisely that.
It stands to reason that if some proofs require chaining 250k pages together, no human would ever be able to put it together. That doesn't mean something that is capable of doing so is necessarily super-intelligent.
Still very impressive, and if true, a wonderful result of the symbiotic interplay between a human and a machine, each at what they are good at.
It's unfortunate we're always focused on humans getting usurped by an "AI", instead of the reality that these models only succeed when we're there to show them what success looks like.
What if "superintelligence" is really a hybrid result of humans using and guiding these large pattern interpolators?
What if we're not the specialist snowflake?
AI will solve exactly one or two millennium problems.
So I will become impressed by something, but only this is not enough. If AI solve three or more problems, I will become impressed and believe that some serious RSI stuff might be happening. If AI couldn't solve any problem (which it seems it did) I would become impressed in the other direction, and believe AI got stuck in a way that I didn't imagined (together with other 9 statements).
There may exist people (like me) who don't believe superintelligence is happening with current set of evidences, but believe it with some stronger evidences.
I think it's a perfectly sane position to acknowledge amazing progress with very large neural networks, expect further progress, and also not buy into the specific mythology around the singularity or extropianism.
These things come bundled together quite often, and that's what I see people (reasonably, imo) resisting.
Doesn't mean there isn't unfair dismissal too, but I feel that's gotten much more rare.
"Experience has shown that, even now, there will still be people explaining in patronizing tones why none of this is real and none of it counts. If such people were capable of being impressed by anything that happens in the empirical world, of updating on anything, they would’ve already been impressed and already updated several years ago, long before things had reached the point of an actual Mathocalypse."