News for hackers. Stuff that matters.
Re:Stanford A.I. Courses by chongli on Sunday July 02, 2023 @12:46PM (#36563173)
How long has it been since you studied/used university-level math? Calculus and linear algebra in particular.

I ask because it’s pretty difficult to get through the math of backprop without a firm grasp of these. The Python part is trivial by comparison, the main difficulty being the matching of dimensions.

Re:Stanford A.I. Courses by bob88jg on Sunday July 02, 2023 @01:06PM (#36563358)
It's nothing more than the chain rule...University level it is not...the engineering aspect is the non trivial part IMHO...
Re:Stanford A.I. Courses by godelski on Sunday July 02, 2023 @03:54PM (#36565037)
While many learn calculus in high school, many also don't get it till uni. Not everyone is at your level, or took your same path, and that's okay. Don't shame people for not knowing when they're trying to learn.
Re:Stanford A.I. Courses by chongli on Sunday July 02, 2023 @04:12PM (#36565184)
The gradient of softmax is beyond most high school calculus students.