News for hackers. Stuff that matters.
Re:John Carmack and Rich Sutton partner to accelerate develo... by Skyy93 on Saturday October 07, 2023 @07:53AM (#37800942)
Perhaps there is some belief in this that an AGI can save us from our biggest problems? Energy Crisis, Environmental Pollution, Waging Wars.

But I agree with you ... it is not really urgent since we know answers for the most of the problems but do not like the solution.

Re:John Carmack and Rich Sutton partner to accelerate develo... by xpe on Saturday October 07, 2023 @07:55AM (#37800954)
A “solution” that isn’t viable nor palatable isn’t a true solution; it is often merely a hope that people are not people.
Re:John Carmack and Rich Sutton partner to accelerate develo... by Skyy93 on Saturday October 07, 2023 @07:57AM (#37800965)
Than there will be never be a solution to some problems.
Re:John Carmack and Rich Sutton partner to accelerate develo... by tharne on Saturday October 07, 2023 @09:46AM (#37801659)
You’re presupposing every problem has a nice solution. This is almost certainly false
Re:John Carmack and Rich Sutton partner to accelerate develo... by ang_cire on Saturday October 07, 2023 @11:03AM (#37802282)
Any solution is a nice solution depending on your frame of reference. There is no such thing as objectively good or bad without defining the acceptable and unacceptable effects.
Re:John Carmack and Rich Sutton partner to accelerate develo... by nine_k on Saturday October 07, 2023 @02:24PM (#37804214)
There is an implied frame of reference that requires the continued existence of humans.

Any solution that violates this boundary condition is "objectively bad", that is, cultures that follow this solution disappear and thus lose the evolution game.

Re:John Carmack and Rich Sutton partner to accelerate develo... by xpe on Monday October 09, 2023 @11:05AM (#37821212)
I take your point but...

1. There are a set of things that are nearly objectively true across nearly all cultures. For example, random killing for selfish purposes is not ok.

2. I'm not a moral relativist, in two senses. First, the "weak" sense: I would prefer to live in some moral systems more than others. Second, in "nearly-strong" sense: some moral systems are 'nearly' objectively better than others (see point above). (Note: my definitions are imprecise; still working on how to square them with existing philosophical writings.)

3. Even for people that evaluate the morality of something according to its effects (consequentialists), there is considerable room to debate the relevant time frame.

Re:John Carmack and Rich Sutton partner to accelerate develo... by Qwertious on Saturday October 07, 2023 @11:14AM (#37802394)
Lots of problems could be at least severely mitigated if you could throw literally millions of bodies at the problem - if AGI could deliver a $50 chip that could substitute for a human, then could shove each one into a roomba wired to an arm, and you basically have an infinite free workforce.
Re:John Carmack and Rich Sutton partner to accelerate develo... by gretch on Saturday October 07, 2023 @01:23PM (#37803600)
Yeah except, how do you manufacture them? And distribute them to where the work needs to be? And what type of fuel do they use - we don’t have infinite free energy for an infinite free workforce.
Re:John Carmack and Rich Sutton partner to accelerate develo... by xpe on Monday October 09, 2023 @10:58AM (#37821130)
> You’re presupposing every problem has a nice solution.

Not at all. Where are you getting that?

Re:John Carmack and Rich Sutton partner to accelerate develo... by lttlrck on Saturday October 07, 2023 @10:06AM (#37801810)
Viability is a given. But palatability? That's like giving up and saying there are no solutions to hard problems.
Re:John Carmack and Rich Sutton partner to accelerate develo... by xpe on Monday October 09, 2023 @10:58AM (#37821129)
I take your point. Palatability can change.

> That's like giving up and saying there are no solutions to hard problems.

Not at all. I'm simply defining a solution as one that has some probability of traction.

Re:John Carmack and Rich Sutton partner to accelerate develo... by garblegarble on Saturday October 07, 2023 @08:45AM (#37801264)
>we know answers for the most of the problems but do not like the solution.

What an absolutely wonderful insight put extremely succinctly, thank you!

Re:John Carmack and Rich Sutton partner to accelerate develo... by sschueller on Saturday October 07, 2023 @09:43AM (#37801640)
A true AGI would determine the only solution to our crisis is the elimination of the human race...
Re:John Carmack and Rich Sutton partner to accelerate develo... by dartos on Saturday October 07, 2023 @09:58AM (#37801740)
Are you just basing that idea off of sci fi novels?
Re:John Carmack and Rich Sutton partner to accelerate develo... by charlie0 on Saturday October 07, 2023 @10:36AM (#37802050)
It would probably be the simplest solution to a naive super intelligent agi. Just take a look at how humanity dealt with dangerous animals. They are mostly no longer around unless in a zoo.
Re:John Carmack and Rich Sutton partner to accelerate develo... by esrauch on Saturday October 07, 2023 @11:15AM (#37802411)
Humans don't put ants in zoos because the ants overconsume their localized habitat though. A naive super intelligent agi has no reason to care if global warming makes the planet 150 degrees F on average, if it's self-interested it would surely be able to be "ok" on a planet under those conditions.
Re:John Carmack and Rich Sutton partner to accelerate develo... by charlie0 on Saturday October 07, 2023 @11:24AM (#37802502)
Sure, but at some point it will be asked to solve those problems and if it's not properly built, could easily arrive at that conclusion from a problem solving perspective. Self interest doesn't have to come into play at all here.
Re:John Carmack and Rich Sutton partner to accelerate develo... by AuryGlenz on Saturday October 07, 2023 @09:03PM (#37806938)
If it’s tasked with solving those problems it can also be done with constraints such as “without killing humans.”
Re:John Carmack and Rich Sutton partner to accelerate develo... by hskalin on Monday October 09, 2023 @12:09AM (#37816859)
Not if you add a constraint that ensures survival of humanity.