xksteven
Re:Some thoughts on machine learning with small data
on Friday June 03, 2022 @11:36AM (#31609760)
I'd be careful of over applying the "bias-variance tradeoff." How to define the variance of a model is not a simple task. I wouldn't say it is immediately obvious how bias-variance relates to small data scenarios.
How much data is considered small? What is the complexity of the dataset itself?
Even in Machine Learning it is possible to learn from small datasets without transfer learning. See meta-learning for instance.
Re:Alias-Free GAN
on Wednesday June 23, 2021 @05:08PM (#27610402)
Sometimes reimplantation is impossible without the code and the paper goes on to win awards because it's by a famous scientist. Then if the reimplantation doesn't work most of the time the graduate students are blamed instead of the original work.
There are always assumptions. At least with public code and models those assumptions are laid bare for all to see and potentially expose any bad assumptions.
Re:Every Model Learned by Gradient Descent Is Approximately a Kernel M...
on Sunday December 06, 2020 @12:44PM (#25325103)
My understanding of the read was to show "how" they're equivalent as opposed to how to actually construct such an approximator or learn it.
Similar to showing a problem falls in NP, you can reduce the problem down to another problem in NP and be done with it.
Re:Every Model Learned by Gradient Descent Is Approximately a Kernel M...
on Sunday December 06, 2020 @12:42PM (#25325087)
That's correct. See https://en.wikipedia.org/wiki/Universal_approximation_theore... for more details
Re:Every Model Learned by Gradient Descent Is Approximately a Kernel M...
on Sunday December 06, 2020 @12:40PM (#25325071)
SVMs are solved via convex optimization methods which have taken more time to get on the GPU train.
On the other hand there are GPU accelerated SVM training such as: https://github.com/Xtra-Computing/thundersvm
A github or Google search will reveal other GPU accelerated SVM training.
Re:Ask HN: Who wants to be hired? (December 2020)
on Thursday December 03, 2020 @06:26PM (#25296861)
Location: Miami, Florida
Remote: Yes
Willing to relocate: Yes
Technologies: Python, Node, Pytorch, Tensorflow
Résumé/CV: https://stevenbas.art/resources/resume/
Email: [email protected]
Software Engineer
I have been working on machine learning problems in computer vision and natural language processing for my PhD over the past 5 years.