Re:DeepMind’s New Language Model, Chinchilla
by binarymax on Monday April 11, 2022 @09:40AM
(#30988533)
Large language models have a (recent) history of silly names. BERT, BART, ELMO, RoBERTa, BIGBIRD, PaLM, Megatron etc. Might as well go full nonsense.
[ Parent
| on HN ]
Re:DeepMind’s New Language Model, Chinchilla
by MisterTea on Monday April 11, 2022 @10:28AM
(#30989220)
My theory is since no one reads literature anymore, timeless, interesting and unique names from history and other cultures are lost to a deluge of soon to be forgotten gag, pop-culture and meme names. Perhaps this is why we have Chinchilla and not Oberon.
Re:DeepMind’s New Language Model, Chinchilla
by jankeymeulen on Monday April 11, 2022 @11:25AM
(#30990095)
Like the Oberon OS and programming language?
Image models too - the Inception paper from 2014 directly refers to knowyourmeme.com and the "we need to go deeper" meme from the movie Inception - https://knowyourmeme.com/memes/we-need-to-go-deeper - it's the first reference in the paper [1] and it's also why the model is called that way.
Re:DeepMind’s New Language Model, Chinchilla
by DSingularity on Monday April 11, 2022 @10:04AM
(#30988858)
A touch of irony that cutting edge research on language can’t produce better names.
Re:DeepMind’s New Language Model, Chinchilla
by omarhaneef on Monday April 11, 2022 @09:53AM
(#30988701)
True. I will add that it is customary to justify it by demonstrating it is some sort of acronym or contraction.
Re:DeepMind’s New Language Model, Chinchilla
by yeetsfromhellL2 on Monday April 11, 2022 @10:04AM
(#30988861)
It's a recursive, selective acronym
C
CH
CHI
CHIN
CHINC
CHINCH
CHINCHI
CHINCHIL
CHINCHILL
==> CHINCHILLA
HINCHILLA
INCHILLA
NCHILLA
CHILLA
HILLA
ILLA
LLA
LA
A
Re:DeepMind’s New Language Model, Chinchilla
by omarhaneef on Monday April 11, 2022 @10:11AM
(#30988964)
I know what recursive means, I know what selective means, I know what an acronym is, and I think I see the pattern in that picture, but when I put it all together I am lost.
Alternatively, is this a joke and the "recursive, selective acronym" can be used to justify any word?