Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Nvidia DGX GH200: The First 100 Terabyte GPU Memory System. Parent comment
That rule of thumb is wrong. The chinchilla paper has it anywhere between 1 and 100 tokens per parameter.
There are no comments on this comment yet.
That rule of thumb is wrong. The chinchilla paper has it anywhere between 1 and 100 tokens per parameter.