News for hackers. Stuff that matters.
Re:Hand-picked selection of articles on AI fundamentals/conc... by fragmede on Monday August 11, 2025 @02:40PM (#44867821)
The paper itself is fairly popular, with several thousand citations.

Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer

Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, Jeff Dean

https://arxiv.org/abs/1701.06538

There are no comments on this comment yet.