News for hackers. Stuff that matters.
Re:Chinchilla Scaling: A Replication Attempt by cgearhart on Thursday April 18, 2024 @12:06PM (#40077647)
TL;DR—couldn’t exactly replicate their results, but broadly confirmed their findings. They agree that the optimal range is 5–40 tokens per parameter, and close to 20 for the “chinchilla” model from the original paper.

Very unusual choice to reconstruct the dataset by eyeballing the graph in the source paper (why not just ask for it…?) and it’s not really clear why the result is dressed up behind the salacious-seeming abstract.

Re:Chinchilla Scaling: A Replication Attempt by ege_erdil on Thursday April 18, 2024 @05:35PM (#40080971)
we didn't eyeball the graph, there are more accurate ways of extracting the data from a pdf file than that

we did ask for the data but got no response until we published on arxiv

what is supposed to be "salacious" about the abstract?