News for hackers. Stuff that matters.
Re:DeepMind’s New Language Model, Chinchilla by binarymax on Monday April 11, 2022 @09:40AM (#30988533)
Large language models have a (recent) history of silly names. BERT, BART, ELMO, RoBERTa, BIGBIRD, PaLM, Megatron etc. Might as well go full nonsense.
Re:DeepMind’s New Language Model, Chinchilla by MisterTea on Monday April 11, 2022 @10:28AM (#30989220)
My theory is since no one reads literature anymore, timeless, interesting and unique names from history and other cultures are lost to a deluge of soon to be forgotten gag, pop-culture and meme names. Perhaps this is why we have Chinchilla and not Oberon.
Re:DeepMind’s New Language Model, Chinchilla by jankeymeulen on Monday April 11, 2022 @11:25AM (#30990095)
Like the Oberon OS and programming language?
Re:DeepMind’s New Language Model, Chinchilla by jstx1 on Monday April 11, 2022 @11:00AM (#30989742)
Image models too - the Inception paper from 2014 directly refers to knowyourmeme.com and the "we need to go deeper" meme from the movie Inception - https://knowyourmeme.com/memes/we-need-to-go-deeper - it's the first reference in the paper [1] and it's also why the model is called that way.

[1] https://arxiv.org/pdf/1409.4842.pdf

Re:DeepMind’s New Language Model, Chinchilla by DSingularity on Monday April 11, 2022 @10:04AM (#30988858)
A touch of irony that cutting edge research on language can’t produce better names.
Re:DeepMind’s New Language Model, Chinchilla by omarhaneef on Monday April 11, 2022 @09:53AM (#30988701)
True. I will add that it is customary to justify it by demonstrating it is some sort of acronym or contraction.
Re:DeepMind’s New Language Model, Chinchilla by yeetsfromhellL2 on Monday April 11, 2022 @10:04AM (#30988861)
It's a recursive, selective acronym

               C
              CH
             CHI
            CHIN
           CHINC
          CHINCH
         CHINCHI
        CHINCHIL
       CHINCHILL
  ==> CHINCHILLA
      HINCHILLA
      INCHILLA
      NCHILLA
      CHILLA
      HILLA
      ILLA
      LLA
      LA
      A
Re:DeepMind’s New Language Model, Chinchilla by omarhaneef on Monday April 11, 2022 @10:11AM (#30988964)
I know what recursive means, I know what selective means, I know what an acronym is, and I think I see the pattern in that picture, but when I put it all together I am lost.

Alternatively, is this a joke and the "recursive, selective acronym" can be used to justify any word?

Re:DeepMind’s New Language Model, Chinchilla by veonik on Monday April 11, 2022 @10:26AM (#30989192)

               A
              AR
             ARB
            ARBI
           ARBIT
          ARBITR
         ARBITRA
        ARBITRAR
  ==>  ARBITRARY
       RBITRARY
       BITRARY
       ITRARY
       TRARY
       RARY
       ARY
       RY
       Y


Yup, seems it works for any word.