News for hackers. Stuff that matters.
Re:GPT-4 by noisy_boy on Tuesday March 14, 2023 @01:01PM (#35154626)
At this rate, I have no idea what the state of things would be even 6 months down the line.
Re:GPT-4 by chairhairair on Tuesday March 14, 2023 @01:23PM (#35155012)
We’re rapidly approaching problems (AP Calculus BC, etc) that are in the same order of magnitude of difficulty as “design and implement a practical self-improving AI architecture”.

Endless glib comments in this thread. We don’t know when the above prompt leads to takeoff. It could be soon.

Re:GPT-4 by dw_arthur on Tuesday March 14, 2023 @01:33PM (#35155189)
We can't predict what is coming. I think it probably ends up making the experience of being a human worse, but I can't avert my eyes. Some amazing stuff has and will continue to come from this direction of research.
Re:GPT-4 by plaidfuji on Tuesday March 14, 2023 @01:50PM (#35155483)
And funnily enough, with the AI community’s dedication to research publications being open access, it has all the content it needs to learn this capability.

“But how did skynet learn to build itself?”

“We showed it how.”

Re:GPT-4 by James_Henry on Tuesday March 14, 2023 @01:53PM (#35155554)
Since when was AP Calculus BC on the same order of magnitude as "design and implement a practical self-improving AI architecture"?
Re:GPT-4 by chairhairair on Tuesday March 14, 2023 @02:19PM (#35156079)
Assuming the range of intelligence spanning all the humans that can pass Calculus BC is narrow on the scale of all possible intelligences.

It’s a guess, of course. But, the requisite concepts for getting Transformers working are not much broader than calculus and a bit of programming.

Re:GPT-4 by James_Henry on Tuesday March 14, 2023 @05:16PM (#35158830)
Since when was "design and implement a practical self-improving AI architecture" on the same level as knowing "the requisite concepts for getting Transformers working"?
Re:GPT-4 by 00F_ on Tuesday March 14, 2023 @07:25PM (#35160958)
this is such garbage logic. the semantics of that comment are irrelevant. creating and testing AI node structures is well within the same ballpark. even if it wasnt, the entire insinuation of your comment is that the creation of AI is a task that is too hard for AI or for an AI we can create anytime soon -- a refutation of the feedback hypothesis. well, thats completely wrong. on all levels.
Re:GPT-4 by James_Henry on Wednesday March 15, 2023 @03:16PM (#35173334)
Sorry, what is the "feedback hypothesis"? Also, despite my use of quotes, I'm not arguing about semantics.
Re:GPT-4 by ryanwaggoner on Tuesday March 14, 2023 @02:19PM (#35156095)
That's a pretty unfair comparison. We know the answers to the problems in AP Calculus BC, whereas we don't even yet know whether answers are possible for a self-improving AI, let alone what they are.
Re:GPT-4 by evouga on Tuesday March 14, 2023 @03:23PM (#35157029)
I passed Calculus BC almost 20 years ago. All this time I could have been designing and implementing a practical self-improving AI architecture? I must really be slacking.
Re:GPT-4 by dwaltrip on Tuesday March 14, 2023 @04:17PM (#35157770)
In the broad space of all possible intelligences, those capable of passing calc BC and those capable of building a self-improving AI architecture might not be that far apart.
Re:GPT-4 by ignoramous on Tuesday March 14, 2023 @04:43PM (#35158208)
> Endless glib comments in this thread.

Either the comments are glib and preposterous or they are reasonable and enlightening. I guess they are neither but our narrow mindedness makes it so?

Re:GPT-4 by 7373737373 on Tuesday March 14, 2023 @06:43PM (#35160217)
A few hundred people on Metaculus are predicting weakly general AI to be first known around September 2027: https://www.metaculus.com/questions/3479/date-weakly-general...
Re:GPT-4 by 00F_ on Tuesday March 14, 2023 @07:28PM (#35161015)
hey, im very concerned about AI and AGI and it is so refreshing to read your comments. over the years i have worried about and warned people about AI but there are astonishingly few people to be found that actually think something should be done or even that anything is wrong. i believe that humanity stands a very good chance of saving itself through very simple measures. i believe, and i hope that you believe, that even if the best chance we had at saving ourselves was 1%, we should go ahead and at least try. in light of all this, i would very much like to stay in contact with you. ive connected with one other HN user so far (jjlustig) and i hope to connect with more so that together we can effect political change around this important issue. ive formed a twitter account to do this, @stop_AGI. whether or not you choose to connect, please do reach out to your state and national legislators (if in the US) and convey your concern about AI. it will more valuable than you know.
Re:GPT-4 by zirgs on Tuesday March 14, 2023 @01:18PM (#35154924)
Hopefully a fully open sourced LLM that can be run on consumer hardware like Stable Diffusion.

Yeah, I know about LLAMA, but as I understand - it's not exactly legal to use and share it.

Re:GPT-4 by meghan_rain on Tuesday March 14, 2023 @01:25PM (#35155046)
Dear AI gods, all I want for this Christmas is this.
Re:GPT-4 by freedomben on Tuesday March 14, 2023 @02:15PM (#35156004)
Fortunately, within 9 months I expect we'll get this for Christmas
Re:GPT-4 by mixedCase on Tuesday March 14, 2023 @01:43PM (#35155375)
> Yeah, I know about LLAMA, but as I understand - it's not exactly legal to use and share it.

For anyone keeping track, this is when you update your cyberpunk dystopia checklist to mark off "hackers are running illegal AIs to compete with corporations".

Re:GPT-4 by baq on Tuesday March 14, 2023 @05:13PM (#35158771)
For the record I’ve saved the first comment where I mistake a real person’s comment for a LLM and it was not today
Re:GPT-4 by baal80spam on Tuesday March 14, 2023 @01:13PM (#35154806)
Singularity /s
Re:GPT-4 by unsupp0rted on Tuesday March 14, 2023 @01:20PM (#35154949)
Singularity no /s

Somewhere in the range of 6 months ~ 6 years

Where singularity = something advanced enough comes along that we can't understand or predict or keep up with it, because it's so far beyond us and changing so far faster than our ape brains can perceive, and (hopefully) it brings us along for the ride.

No promises it'll be evenly distributed though.

Re:GPT-4 by WXLCKNO on Tuesday March 14, 2023 @01:44PM (#35155384)
I would imagine that large language models will plateau like smartphones did. Until a next step happens which unlocks something bigger.
Re:GPT-4 by unsupp0rted on Tuesday March 14, 2023 @01:59PM (#35155657)
The idea is that eventually we build something that, when it plateaus, builds its own successor. That’s the singularity: when the thing in question builds its successor and that builds its successor and this happens far outside our ability to understand or keep up.

Can GPT9 build GPT10, with zero human input?

I’d give 50/50 odds it can.

Can GPT15 build something that isn’t a large language model and is far superior in every way?

I’d give 50/50 odds it can.

Can both the above steps happen within one solar rotation of each other?

I’d give 50/50 odds they can.

Because at some point these models won’t need humans to interact with them. Humans are very slow- that’s the bottleneck.

They’ll simply interact with their own previous iterations or with custom-instantiated training models they design themselves. No more human-perceptible timescale bottlenecks.

Re:GPT-4 by oezi on Tuesday March 14, 2023 @02:10PM (#35155900)
I would wager that GPT-6 or 7 will become sufficiently capable to drive an independent agenda and evolve for instance into a cybercrime gang.

50/50 chance of Skynet.

Re:GPT-4 by baq on Tuesday March 14, 2023 @05:16PM (#35158818)
50/50 are not good odds for Homo sapiens, not good at all
Re:GPT-4 by unsupp0rted on Tuesday March 14, 2023 @05:50PM (#35159395)
Well for Homo sapiens the odds are probably a hundredth or a thousandth of that.

It’s 50/50 that in 150 years some version of our descendants will exist, i.e. something that you can trace a direct line from Homo sapiens to. Say a Homo sapiens in a different substrate, like “human on a chip”.

The thing is if you can get “human on a chip” then you probably also can get “something different and better than human on a chip”, so why bother.

By the 24th century there’ll be no Homo sapiens Captain Picard exploring the quadrant in a gigantic ship that needs chairs, view screens, artificial gravity, oxygen, toilets and a bar. That’s an unlikely future for our species.

More likely whatever replaces the thing that replaces the thing that replaced us won’t know or care about us, much less need or want us around.

Re:GPT-4 by Tostino on Tuesday March 14, 2023 @02:04PM (#35155769)
I honestly don't think it will be quite like that, at least not terribly soon. There is so much work being done to hook up LLMs to external sources of data, allow them to build longer term memories of interactions, etc. Each of these areas are going to have massive room to implement competing solutions, and even more room for optimization.
Re:GPT-4 by unsupp0rted on Tuesday March 14, 2023 @02:21PM (#35156117)
Ray Kurzweil predicted in 1999 that all of this would happen roughly now-ish, with 2029 being when something passes a hard version of the Turing test.

He was an uninformed crackpot with a poor understanding of statistics. And then less so. And then less so.

Something passing the Turing test 6 months to 6 years from now? Lunacy.

But give it 6 months and talk to GPT5 or 6 and then this might seem a lot more reasonable.

Re:GPT-4 by falcor84 on Tuesday March 14, 2023 @05:08PM (#35158675)
> He was an uninformed crackpot with a poor understanding of statistics.

There's a lot you can say about Kurzweil being inaccurate in his predictions, but that is way too demeaning. Here's what Wikipedia has to say about him and the accolades he received:

Kurzweil received the 1999 National Medal of Technology and Innovation, the United States' highest honor in technology, from then President Bill Clinton in a White House ceremony. He was the recipient of the $500,000 Lemelson-MIT Prize for 2001. He was elected a member of the National Academy of Engineering in 2001 for the application of technology to improve human-machine communication. In 2002 he was inducted into the National Inventors Hall of Fame, established by the U.S. Patent Office. He has received 21 honorary doctorates, and honors from three U.S. presidents. The Public Broadcasting Service (PBS) included Kurzweil as one of 16 "revolutionaries who made America" along with other inventors of the past two centuries. Inc. magazine ranked him No. 8 among the "most fascinating" entrepreneurs in the United States and called him "Edison's rightful heir".

https://en.wikipedia.org/wiki/Ray_Kurzweil

Re:GPT-4 by unsupp0rted on Tuesday March 14, 2023 @05:20PM (#35158911)
I’ve been a Kurzweil supporter since high school, but to the wider world he was a crackpot (inventor who should stick to his lane) who had made a couple randomly lucky predictions.

He wasn’t taken seriously, especially not when he painted a future of spiritual machines.

Recently on the Lex Fridman podcast he himself said as much: his predictions seemed impossible and practically religious in the late 90s and up until fairly recently, but now experts in the field are lowering their projections every year for when the Turing test will be passed.

Half of their projections are now coming in line with the guy they had dismissed for so long, and every year this gap narrows.

Re:GPT-4 by wwwtyro on Tuesday March 14, 2023 @01:48PM (#35155458)
By that definition, I wonder if we've already surpassed that point. Things on the horizon certainly feel hazier to me, at least. I think a lot of people were surprised by the effectiveness of the various GPTs, for example. And even hard science fiction is kinda broken: humans piloting spaceships seems highly unlikely, right? But it's a common occurrence there.
Re:GPT-4 by unsupp0rted on Tuesday March 14, 2023 @02:06PM (#35155818)
When we’ve surpassed that point you’ll likely know it, unless the Master(s) is/are either malicious or covert for benevolent reasons.
Re:GPT-4 by kristiandupont on Tuesday March 14, 2023 @01:29PM (#35155122)
That would be my response but without the /s. Of course, depending on the definition it can always be said to be "happening", but to me it feels like the angle of the curve is finally over 45 degrees.
Re:GPT-4 by layer8 on Tuesday March 14, 2023 @01:42PM (#35155362)
Note that GPT-3 is 2.5 years old (counting from the beta), and that from what is publicly known, GPT-4 was already in development in 2021.