Anthropic hires OpenAI co-founder Durk Kingma

Re:Anthropic hires OpenAI co-founder Durk Kingma by modeless on Tuesday October 01, 2024 @04:10PM (#41713544)

Kingma is most notable for writing one of the most cited papers in AI; actually one of the most cited scientific papers ever published, right up there with the transformers paper if not higher. "Adam: A Method for Stochastic Optimization" https://arxiv.org/abs/1412.6980

I remain astonished that Adam continues to be the most widely used optimizer in AI 10 years later. So many contenders have failed to replace it.

[ Parent | on HN ]

Re:Anthropic hires OpenAI co-founder Durk Kingma by supafastcoder on Tuesday October 01, 2024 @04:58PM (#41714090)

I mean, there’s only so many ways to optimize a black box

[ Parent | on HN ]

Re:Anthropic hires OpenAI co-founder Durk Kingma by LarsDu88 on Tuesday October 01, 2024 @05:01PM (#41714108)

The number of papers that use it exceed the number of papers that cite it probably by 100x!

[ Parent | on HN ]

Re:Anthropic hires OpenAI co-founder Durk Kingma by OutOfHere on Tuesday October 01, 2024 @05:32PM (#41714423)

(delete)

[ Parent | on HN ]

Re:Anthropic hires OpenAI co-founder Durk Kingma by esafak on Tuesday October 01, 2024 @05:41PM (#41714528)

That's an architecture, not an optimizer. You can probably use ADAM with KANs. I think you latched on to the transformers in the sentence, but Kingma did not invent those.

[ Parent | on HN ]

Re:Anthropic hires OpenAI co-founder Durk Kingma by p1esk on Tuesday October 01, 2024 @05:45PM (#41714568)

In my opinion, he is more notable for inventing a variational autoencoder.

[ Parent | on HN ]