News for hackers. Stuff that matters.
Re:Towards the Cutest Neural Network by 01HNNWZ0MV43FF on Monday May 05, 2025 @07:40PM (#43900474)
Ah makes sense.

No, coordinate descent is a stupider gradient-optional method: https://en.wikipedia.org/wiki/Coordinate_descent

It's slow and sub-optimal, but the code is very easy to follow and you don't have to wonder whether your gradient is correct.

There are no comments on this comment yet.