News for hackers. Stuff that matters.
Re:Towards 1-bit Machine Learning Models by corysama on Friday March 29, 2024 @12:20PM (#39865855)
I look forward to the inevitable probabilistic sub-bit machine learning models :)
Re:Towards 1-bit Machine Learning Models by paul_mk1 on Friday March 29, 2024 @01:57PM (#39867046)
Sub 1-bit has been done at least as far back as 2016 for VGG style networks (my work).

I was able to get 0.68 "effective" bits.

The idea is that in each forward pass you add noise to each weight independently drawn from normal distribution, and when you calculate snr, it's sub 1 bit. Points to the idea that a stochastic memory element can be used.

https://arxiv.org/abs/1606.01981

Re:Towards 1-bit Machine Learning Models by overengineer on Saturday March 30, 2024 @06:53AM (#39873627)
If noise is desirable in this way, why not to just switch back to analog computing which comes with free noise
Re:Towards 1-bit Machine Learning Models by Cheer2171 on Friday March 29, 2024 @12:57PM (#39866294)
My 0-bit model can predict if you have cancer with 99.5% accuracy. It doesn't even need input data! Don't ask about the false negative rate though.
Re:Towards 1-bit Machine Learning Models by asah on Friday March 29, 2024 @02:03PM (#39867122)
My 0-bit, no-input model can predict if you have cancer with 99.5% accuracy and 0.5% false negative rate. Don't ask about whether the cancer cell(s) are benign.
Re:Towards 1-bit Machine Learning Models by ganzuul on Saturday March 30, 2024 @02:51PM (#39877547)
My computation-free model can give you cancer with 100% certainty.
Re:Towards 1-bit Machine Learning Models by Cieric on Friday March 29, 2024 @12:34PM (#39866025)
I assume this is ment to be a joke, but isn't this actually being worked on? (minus the probabilistic portion) https://arxiv.org/abs/2310.16795