News for hackers. Stuff that matters.
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by elashri on Tuesday October 08, 2024 @06:35AM (#41775798)
As a physicist, my reaction to this is how bizarre is that. Maybe he deserves a nobel prize but in physics?

Also arguing that NN is used in physics so we can argue nobel prize is okay is like asking for Stephan Wolfram to be awarded Nobel prize for Mathematica which is much more used in physics as a tool. And he is a physicist and had contributions to the field of numerical relativity (The reason he created Mathematica in the first place).

The royal science academy fucked up so much with this choice.

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by lr1970 on Tuesday October 08, 2024 @07:00AM (#41775962)
By this definition Claude Shannon (the father of Information Theory) clearly deserves a Nobel in Physics. The central concept in Information Theory is Entropy which is defined literally the same way as in Physics. And Shannon's Information Theory clearly revolutionized our life (tele-communications) much more than Hopfield network or Hinton's Boltzmann machine.
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by drpossum on Tuesday October 08, 2024 @07:03AM (#41775985)
Fun historical fact: Claude Shannon did win the Noble prize

https://en.wikipedia.org/wiki/Alfred_Noble_Prize#Recipients

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by elashri on Tuesday October 08, 2024 @07:06AM (#41775998)
That's different local prize by the American society of civil engineers.

https://en.wikipedia.org/wiki/Alfred_Noble_Prize

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by drpossum on Tuesday October 08, 2024 @07:08AM (#41776018)
Yes. That's the joke.
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by hnfong on Tuesday October 08, 2024 @10:42AM (#41777887)
[party pooping] It would have been better delivery if you said "a Nobel prize" instead of "the".
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by thw09j9m on Tuesday October 08, 2024 @11:20AM (#41778320)
Noble != Nobel
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by hnfong on Tuesday October 08, 2024 @11:39AM (#41778567)
Ah my bad.
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by 77pt77 on Wednesday October 09, 2024 @03:53PM (#41791932)
Still more of a Nobel Prize than the one for Economics.
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by lr1970 on Tuesday October 08, 2024 @07:11AM (#41776040)
In 1939 Claude Shannon won the "wrong" Nobel prize -- The Alfred Noble Prize award presented by the American Society of Civil Engineers [0]. It causes a lot of confusion. Claude Shannon never won a "real Nobel".

[0] https://en.wikipedia.org/wiki/Alfred_Noble_Prize

EDIT: typos

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by amelius on Tuesday October 08, 2024 @06:41AM (#41775841)
It feels a bit like the field of physics claiming the invention of AI, where we all know that mathematics and/or CS deserve the honor.
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by cubefox on Tuesday October 08, 2024 @07:15AM (#41776063)
Someone changed the Wikipedia article today to call Hopfield a "physicist". Previously the article called him simply a scientist, because his main work wasn't limited to physics. I changed it back now, let's see if it holds up.
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by xanderlewis on Tuesday October 08, 2024 @04:55PM (#41781731)
It’s ‘physicist’ again now.
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by cubefox on Tuesday October 08, 2024 @06:59PM (#41782662)
User "ReyHahn" has changed it back to physicist. Justification: "he defines himself as physicist but he has worked i mnay fields"

https://en.wikipedia.org/w/index.php?title=John_Hopfield&dif...

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by xanderlewis on Tuesday October 08, 2024 @09:39PM (#41783634)
To use the local lingo…

[citation needed]

I suppose some might argue that being awarded the Nobel Prize in Physics is enough to call yourself a physicist.

…it does have the unfortunate implication, however, that nominations need not be restricted to physicists at all since any winner becomes a physicist upon receipt of the prize.

It’s sort of like the No True Scotsman but inverted, and with physicists instead of Scotsmen.

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by meindnoch on Tuesday October 08, 2024 @07:05AM (#41775993)
>where we all know that mathematics and/or CS deserve the honor

Or semiconductor manufacturers.

All the math and CS needed for AI can fit on a napkin, and had been known for 200+ years. It's the extreme scaling enabled by semiconductor science that really makes the difference.

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by cubefox on Tuesday October 08, 2024 @07:22AM (#41776101)
That's absurd. The computer science needed for AI has not been known for 200 years. For example, transformers were only invented in 2017, diffusion models in 2015.

(When the required math was invented is a different question, but I doubt all of it was known 200 years ago.)

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by jampekka on Tuesday October 08, 2024 @07:17AM (#41776073)
TBF backpropagation was introduced only in the 1970's, although in hindsight it's a quite trivial application of the chain rule.

There were also plenty of "hacks" involved to make the networks scale such as dropout regularization, batch normalization, semi-linear activation functions (e.g. ReLU) and adaptive stochastic gradient descent methods.

The maths for basic NNs is really simple but the practice of them is really messy.

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by miven on Tuesday October 08, 2024 @07:44AM (#41776250)
Residual connections are also worth mentioning as an extremely ubiquitous adaptation, one will be hard-pressed to find a modern architecture that doesn't use those at least to some extent, to the point where the original Resnet paper sits at over 200k citations according to google scholar[1].

[1] https://scholar.google.com/citations?view_op=view_citation&h...

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by cma on Tuesday October 08, 2024 @04:11PM (#41781355)
Highway nets introduced them in the 90s
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by programjames on Tuesday October 08, 2024 @07:17AM (#41776075)
> All the math and CS needed for AI can fit on a napkin, and had been known for 200+ years.

This isn't really true. If you read a physics textbook from the early 1900s, they didn't really have multivariate calculus and linear algebra expressed as concisely as we do now. It would take several napkins. Plus, statistical mechanics was quite rudimentary, which is important for probability theory.

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by 77pt77 on Wednesday October 09, 2024 @03:55PM (#41791949)
> If you read a physics textbook from the early 1900s, they didn't really have multivariate calculus and linear algebra expressed as concisely as we do now.

This is completely incorrect.

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by zmgsabst on Tuesday October 08, 2024 @07:22AM (#41776107)
I don’t think calculus existed at sufficient rigor 200 years ago.

Computer science wasn’t even a thing 100 years ago.

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by KeplerBoy on Tuesday October 08, 2024 @07:27AM (#41776132)
Calculus has been around for quite some time.

If Newton had the machinery to fit large models to data, he would have done so. No doubt.

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by zmgsabst on Tuesday October 08, 2024 @08:24AM (#41776556)
Cauchy’s main work was under 200 years ago; and there’s been quite a lot of work since.

Again, I’m unsure that calculus existed at sufficient level 200 years ago — it didn’t appear in modern form from either Leibniz or Newton.

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by alkonaut on Tuesday October 08, 2024 @06:59AM (#41775958)
I think the Nobel prize doesn't want any scientific advance to fall outside the range of awards entirely.
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by oefrha on Tuesday October 08, 2024 @07:23AM (#41776115)
The Nobel Committee doesn’t represent the field of physics. I talked to a few former colleagues (theoretical physicists) just now and every one of them found this bizarre.
Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by yreg on Tuesday October 08, 2024 @07:54AM (#41776319)
> Maybe he deserves a nobel prize but in physics?

Which category fits better?

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by rramadass on Tuesday October 08, 2024 @07:29AM (#41776146)
Right; the Nobel Committee has officially "jumped the shark".

Reminds me of the old classic Physics and Politics by Walter Bagehot.

Re:John Hopfield and Geoff Hinton Win Physics Nobel Prize [pdf] by mr_toad on Tuesday October 08, 2024 @09:19PM (#41783531)
> The royal science academy fucked up so much with this choice.

Well, you’re talking about it.