Re:Stochastic gradient descent written in SQL
by Lemaxoxo on Tuesday March 07, 2023 @01:50PM
(#35059408)
Hehe I was wondering if someone would catch that. Rest assured, I know the difference between online and stochastic gradient descent. I admit I used stochastic on Hacker News because I thought it would generate more engagement.
[ Parent
| on HN ]
Re:Stochastic gradient descent written in SQL
by airstrike on Tuesday March 07, 2023 @02:54PM
(#35060308)
Then just call it Non-stochastic Gradient Descent? You can't editorialize titles per HN guidelines
Re:Stochastic gradient descent written in SQL
by Lemaxoxo on Tuesday March 07, 2023 @04:12PM
(#35061295)
Thanks, I wasn't aware.
Re:Stochastic gradient descent written in SQL
by airstrike on Tuesday March 07, 2023 @04:12PM
(#35061310)
My pleasure. You can still edit the title, by the way ;-)
Re:Stochastic gradient descent written in SQL
by westurner on Tuesday March 07, 2023 @07:30PM
(#35063522)
What are some adversarial cases for gradient descent, and/or what sort of DVC or W3C PROV provenance information should be tracked for a production ML workflow?
Gradient descent: https://en.wikipedia.org/wiki/Gradient_descent
Stochastic gradient descent: https://en.wikipedia.org/wiki/Stochastic_gradient_descent
Online machine learning: https://en.wikipedia.org/wiki/Online_machine_learning
adversarial gradient descent site:github.com inurl:awesome : https://www.google.com/search?q=awesome+adversarial+gradient...
Robust machine learning: https://en.wikipedia.org/wiki/Robustness_(computer_science)#...
Robust gradient descent
Re:Stochastic gradient descent written in SQL
by craigacp on Tuesday March 07, 2023 @09:13PM
(#35064339)
We built model & data provenance into our open source ML library, though it's admittedly not the W3C PROV standard. There were a few gaps in it until we built an automated reproducibility system on top of it, but now it's pretty solid for all the algorithms we implement. Unfortunately some of the things we wrap (notably TensorFlow) aren't reproducible enough due to some unfixed bugs. There's an overview of the provenance system in this reprise of the JavaOne talk I gave here https://www.youtube.com/watch?v=GXOMjq2OS_c. The library is on GitHub - https://github.com/oracle/tribuo.