News for hackers. Stuff that matters.
Re:Show HN: Boldly go where Gradient Descent has never gone ... by boywitharupee on Sunday May 26, 2024 @02:16PM (#40484199)
how would you compare this to the polytope model? https://en.wikipedia.org/wiki/Polytope_model
Re:Show HN: Boldly go where Gradient Descent has never gone ... by frankling_ on Sunday May 26, 2024 @02:33PM (#40484324)
Not super closely related: the polytope model (to the degree I'm familiar with it) is used as a representation that facilitates optimization of loop nests. That's optimization in the sense of finding an efficient program.

DiscoGrad deals with (or provides gradients for) mathematical optimization. In our case, the goal is to minimize or maximize the program's numerical output by adjusting it's input parameters. Typically, your C++ program will run somewhat slower with DiscoGrad than without, but you can now use gradient descent to quickly find the best possible input parameters.