News for hackers. Stuff that matters.
Re:DeepMind’s New Language Model, Chinchilla by galcerte on Monday April 11, 2022 @09:19AM (#30988255)
I have to ask, why call it that? I had a chuckle once I saw the name.
Re:DeepMind’s New Language Model, Chinchilla by MrBuddyCasino on Monday April 11, 2022 @10:28AM (#30989233)
Its not so bad. If they were radio astronomers they'd call it Very Big Neuronal Language Model. IBM would call it Watson Advanced AI. If they were a gamer accessory company they'd call it DeepTek Ultra Pro VDH-Max AI A320M. Chinchilla is nice and fluffy.
Re:DeepMind’s New Language Model, Chinchilla by binarymax on Monday April 11, 2022 @09:40AM (#30988533)
Large language models have a (recent) history of silly names. BERT, BART, ELMO, RoBERTa, BIGBIRD, PaLM, Megatron etc. Might as well go full nonsense.
Re:DeepMind’s New Language Model, Chinchilla by MisterTea on Monday April 11, 2022 @10:28AM (#30989220)
My theory is since no one reads literature anymore, timeless, interesting and unique names from history and other cultures are lost to a deluge of soon to be forgotten gag, pop-culture and meme names. Perhaps this is why we have Chinchilla and not Oberon.
Re:DeepMind’s New Language Model, Chinchilla by jankeymeulen on Monday April 11, 2022 @11:25AM (#30990095)
Like the Oberon OS and programming language?
Re:DeepMind’s New Language Model, Chinchilla by jstx1 on Monday April 11, 2022 @11:00AM (#30989742)
Image models too - the Inception paper from 2014 directly refers to knowyourmeme.com and the "we need to go deeper" meme from the movie Inception - https://knowyourmeme.com/memes/we-need-to-go-deeper - it's the first reference in the paper [1] and it's also why the model is called that way.

[1] https://arxiv.org/pdf/1409.4842.pdf

Re:DeepMind’s New Language Model, Chinchilla by DSingularity on Monday April 11, 2022 @10:04AM (#30988858)
A touch of irony that cutting edge research on language can’t produce better names.
Re:DeepMind’s New Language Model, Chinchilla by omarhaneef on Monday April 11, 2022 @09:53AM (#30988701)
True. I will add that it is customary to justify it by demonstrating it is some sort of acronym or contraction.
Re:DeepMind’s New Language Model, Chinchilla by yeetsfromhellL2 on Monday April 11, 2022 @10:04AM (#30988861)
It's a recursive, selective acronym

               C
              CH
             CHI
            CHIN
           CHINC
          CHINCH
         CHINCHI
        CHINCHIL
       CHINCHILL
  ==> CHINCHILLA
      HINCHILLA
      INCHILLA
      NCHILLA
      CHILLA
      HILLA
      ILLA
      LLA
      LA
      A
Re:DeepMind’s New Language Model, Chinchilla by omarhaneef on Monday April 11, 2022 @10:11AM (#30988964)
I know what recursive means, I know what selective means, I know what an acronym is, and I think I see the pattern in that picture, but when I put it all together I am lost.

Alternatively, is this a joke and the "recursive, selective acronym" can be used to justify any word?

Re:DeepMind’s New Language Model, Chinchilla by veonik on Monday April 11, 2022 @10:26AM (#30989192)

               A
              AR
             ARB
            ARBI
           ARBIT
          ARBITR
         ARBITRA
        ARBITRAR
  ==>  ARBITRARY
       RBITRARY
       BITRARY
       ITRARY
       TRARY
       RARY
       ARY
       RY
       Y


Yup, seems it works for any word.
Re:DeepMind’s New Language Model, Chinchilla by gwern on Monday April 11, 2022 @05:30PM (#30995355)
There were a lot of complaints about earlier models being named, say, 'Meena'. (It's very sexist, you know, to name a chatbot a female name.) People won't complain about 'Chinchilla' because chinchillas are adorable. PaLMs aren't adorable, but at least it's neutral.
Re:DeepMind’s New Language Model, Chinchilla by redredrobot on Monday April 11, 2022 @10:02AM (#30988830)
It outperforms the Gopher model
Re:DeepMind’s New Language Model, Chinchilla by ellisv on Monday April 11, 2022 @09:52PM (#30997658)
Yet oddly enough I don't think chinchillas are smaller than gophers
Re:DeepMind’s New Language Model, Chinchilla by cshimmin on Monday April 11, 2022 @10:16AM (#30989037)
Yeah, similar "thematic" naming to MacOS versions. I don't know why the original one was called Gopher, though.
Re:DeepMind’s New Language Model, Chinchilla by goodside on Monday April 11, 2022 @12:24PM (#30991043)
Because it retrieves facts from memory in a way that’s analogized to a gopher retrieving objects.
Re:DeepMind’s New Language Model, Chinchilla by farmin on Monday April 11, 2022 @10:13AM (#30988990)
It's the name of a town in QLD.