News for hackers. Stuff that matters.
Re:John Carmack and Rich Sutton partner to accelerate develo... by sillysaurusx on Saturday October 07, 2023 @07:57AM (#37800960)
John is nice to work with. Very numbers-focused. If you have a flaw in your logic, he’ll call you on it. And he’s looking for vice-versa —- nothing seems to make him happier than when you point out a flaw that he hadn’t considered.

I don’t know Rich, but John has said they work well together, and it’s exciting to see them collaborate. There are some unique ideas at Keen worth pursuing that I haven’t seen elsewhere. Looking forward to seeing more researchers join in the future.

Re:John Carmack and Rich Sutton partner to accelerate develo... by throwaway10965 on Saturday October 07, 2023 @08:01AM (#37800989)
Where do you read details about Keen's work and ideas?
Re:John Carmack and Rich Sutton partner to accelerate develo... by sillysaurusx on Saturday October 07, 2023 @08:03AM (#37800998)
You’ll have to join them.
Re:John Carmack and Rich Sutton partner to accelerate develo... by throwaway10965 on Saturday October 07, 2023 @08:04AM (#37801002)
Does that mean you work with them? Can you tell us more about that?
Re:John Carmack and Rich Sutton partner to accelerate develo... by sillysaurusx on Saturday October 07, 2023 @08:20AM (#37801098)
I can’t go into specifics for obvious reasons, but I can tell you they’re a smart, capable crew, with lots of resources, and time is on their side. If I had to place bets on which lab will invent agi, they’d be near the top, precisely because they’re exploring ideas that others don’t seem to be focusing on. It’s the early stages, so it’ll take a few years to get to results. But they’re laser-focused.

There are a bunch of things I thought were cool. John has a worklog going back four years or so, with entries practically every day. He’s nothing if not thorough.

Everyone tends to focus on John, but the other members are just as professional and dedicated. They’re a delight to work with. Also the investors are worth mentioning — Nat in particular has built a super cluster of H100s for startups to use, and has done a bunch of other work to support AI.

Re:John Carmack and Rich Sutton partner to accelerate develo... by HoDaMoFoDor on Saturday October 07, 2023 @08:34AM (#37801189)
How do people apply? They don't seem to have much of a web presence.
Re:John Carmack and Rich Sutton partner to accelerate develo... by sillysaurusx on Saturday October 07, 2023 @08:46AM (#37801270)
I think he sources from people he knows, so your best bet is an intro.
Re:John Carmack and Rich Sutton partner to accelerate develo... by HoDaMoFoDor on Saturday October 07, 2023 @12:14PM (#37802944)
Thanks, I'm pretty interested, but don't have any direct connects.
Re:John Carmack and Rich Sutton partner to accelerate develo... by intelVISA on Saturday October 07, 2023 @08:52AM (#37801312)
I'd accept a massive pay cut to work with such legends :/
Re:John Carmack and Rich Sutton partner to accelerate develo... by gallerdude on Saturday October 07, 2023 @09:56AM (#37801722)
I don’t think spending is their primary constraint; they’re probably looking for talent, no matter the cost.
Re:John Carmack and Rich Sutton partner to accelerate develo... by ativzzz on Saturday October 07, 2023 @12:26PM (#37803069)
It seems more of a place that finds you if you are doing interesting work
Re:John Carmack and Rich Sutton partner to accelerate develo... by chubot on Saturday October 07, 2023 @08:55AM (#37801337)
If I had to place bets on which lab will invent agi

I'd bet against "invent AGI" being a coherent or agreed upon thing, and I'd also bet against the "wake-up" scenario of a system saying "I'm AGI"

Which lab invented deep learning? Certainly U Toronto had the breakthrough that made a 30+ year old field exciting, but there was a lot of work in Montreal, NYU, Google, DeepMind, OpenAI, and many other places

Re:John Carmack and Rich Sutton partner to accelerate develo... by pixl97 on Saturday October 07, 2023 @10:06AM (#37801814)
Hell,LLMs can and do output strings of "I'm AGI", so in some sense we're long past that. The problem is as humans we've never defined what it means for a system to be AGI.
Re:John Carmack and Rich Sutton partner to accelerate develo... by jondwillis on Saturday October 07, 2023 @11:22AM (#37802484)
My back of a napkin definition is that AGI, given the same information and tools as an IQ 100 human, is able to do all of the same tasks that you could ask a human to do, at the same quality level, as well as recall the experience some time later, like a human would likely be able to do.
Re:John Carmack and Rich Sutton partner to accelerate develo... by pixl97 on Saturday October 07, 2023 @12:07PM (#37802874)
The particular issue here is that is subjective as any other subjective definition. 100 IQ is subjective and a moving target. 100 IQ doesn't even mean you can survive and navigate in the real world. Even worse is all humans cannot do all tasks other humans can do and we'd consider them intelligent.

Furthermore this "must behave like a human" blindness represents both a danger, and a way to miss intelligence capabilities leaving them unused/under capitalized. Humans behave like humans because we have human bodies with particular sets of strengths and weaknesses. Other 'intelligent' actors with different embodiment will necessarily behave differently.

Couple that with humans have become far more intelligent and stronger by using tools, that the ability to 'universally' interface with external tooling, at least in my subjective opinion is what will be the defining factor of higher intelligences.

Re:John Carmack and Rich Sutton partner to accelerate develo... by hackernewds on Saturday October 07, 2023 @04:45PM (#37805406)
Could argue ChatGPT can already do a lot of this
Re:John Carmack and Rich Sutton partner to accelerate develo... by cma on Saturday October 07, 2023 @11:09AM (#37802344)
Didn't Schmidhuber's lab predate all of those in their inventions except ReLU (which I've heard is now out of favor as compute outpaces memory bandwidth and other activation functions have better properties).
Re:John Carmack and Rich Sutton partner to accelerate develo... by chubot on Saturday October 07, 2023 @11:34AM (#37802574)
Yeah I should have mentioned him too as evidence of the point!
Re:John Carmack and Rich Sutton partner to accelerate develo... by Michelangelo11 on Saturday October 07, 2023 @10:59AM (#37802249)
Can you share if the approach is more GOFAI or more neural network-type stuff? Just curious, and I understand if you can't say much, of course.
Re:John Carmack and Rich Sutton partner to accelerate develo... by espadrine on Saturday October 07, 2023 @10:21AM (#37801918)
Richard Sutton has done fascinating RL research in the past.

Lately, though, he has been advocating for ending humanity, which is a bit more chilling[1].

[1]: https://youtu.be/NgHFMolXs3U?si=5sriRVFKw61K5yes&t=399

Re:John Carmack and Rich Sutton partner to accelerate develo... by belter on Saturday October 07, 2023 @10:30AM (#37801993)
That is not, what he is advocating, at the timestamp you referred to.
Re:John Carmack and Rich Sutton partner to accelerate develo... by Qwertious on Saturday October 07, 2023 @11:04AM (#37802294)
>That is ... what he is advocating, at the timestamp you referred to.

There's no such thing as taking a quote out of context, only enhancing it!

Re:John Carmack and Rich Sutton partner to accelerate develo... by belter on Saturday October 07, 2023 @12:08PM (#37802889)
There is no such thing as watching the same video and getting to wildly different conclusions :-) I could explain it, but I think would be condescending...
Re:John Carmack and Rich Sutton partner to accelerate develo... by DHaldane on Saturday October 07, 2023 @11:55AM (#37802754)
After watching the video, I agree with that summarization of Rich's arguments. Building AI so humanity can go gently into that good night seemed very much the theme of that talk.

What is your take on it?

Re:John Carmack and Rich Sutton partner to accelerate develo... by belter on Saturday October 07, 2023 @12:07PM (#37802879)
Please watch it again then come back here...
Re:John Carmack and Rich Sutton partner to accelerate develo... by DHaldane on Saturday October 07, 2023 @12:21PM (#37803015)
Curious to hear your take. Sutton seems to present AI as worthy successors to humanity. What do you think he is saying?
Re:John Carmack and Rich Sutton partner to accelerate develo... by belter on Saturday October 07, 2023 @01:21PM (#37803585)
He is only presenting the arguments of Hans Moravec and arguing for Succession Planning. He even mentions...when we can "no longer contribute" and we "enjoy a comfortable retirement". Almost mention the moral argument that we owe to allow a greater mind to evolve. A trans human might even be the only way humanity can survive. Then he contrasts it with the fearful view of the evolution of AI.

From an abstract on "The Age Of Robots": "...rowing computer power over the next half-century will allow this reptile stage will be surpassed, in stages_ _producing robots that learn like mammals, model their world like primates and eventually reason like humans._ _Depending on your point of view, humanity will then have produced a worthy successor, or transcended inherited_ _limitations and transformed itself into something quite new. No longer limited by the slow pace of human learning and_ _even slower biological evolution, intelligent machinery will conduct its affairs on an ever faster, ever smaller scale, until_ _coarse physical nature has been converted to fine-grained purposeful thought..."

https://en.wikipedia.org/wiki/Hans_Moravec

Now where is arguing for the end of Humanity? To quote from his presentation: "...Why don't we rejoice in their greatness as a symbol and extension of humanity greatness, and work together toward a greater and inclusive civilization"

Is Captain Jean-Luc Picard arguing for the end of humanity, is he less of an human? For advocating for Data? - https://youtu.be/ol2WP0hc0NY

Re:John Carmack and Rich Sutton partner to accelerate develo... by omneity on Saturday October 07, 2023 @12:47PM (#37803270)
While I don't agree with your conclusion, as it seems Rich Sutton was simply paraphrasing Hans Moravec, I found the video pretty interesting.

Thank you for sharing it.