News for hackers. Stuff that matters.
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by logicchains on Saturday October 28, 2023 @07:28AM (#38048975)
>On pure research they invented the transformer in 2017 (Vaswani)

Transformers were invented in the early 90s: https://people.idsia.ch/~juergen/fast-weight-programmer-1991... Google were just the first with the compute to scale them up.

Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by blovescoffee on Saturday October 28, 2023 @01:21PM (#38051642)
fwiw Schmidhuber is famous for claiming to have come up with virtually every architecture that's now useful/important.