News for hackers. Stuff that matters.
Re:DeepMind’s New Language Model, Chinchilla by matt123456789 on Monday April 11, 2022 @11:18AM (#30990018)
A parameter is a scalar value, most of which are in the attention matrices and feedforward matrices, you also hear these called “weights”. Any intro to DL course will cover these in detail. I recommend started with Andrew Ng’s Coursera class on Intro to Machine Learning, although there may be better ones out there now.
Re:DeepMind’s New Language Model, Chinchilla by Delitio on Monday April 11, 2022 @12:48PM (#30991469)
Input parameter vs. weights then?

I see tx

Re:DeepMind’s New Language Model, Chinchilla by lostmsu on Monday April 11, 2022 @01:27PM (#30992046)
These networks (text models) usually have around a few thousand inputs.