Re:A Neural Network in 11 Lines of Python (2015)
by amelius on Wednesday October 18, 2017 @02:20PM
(#15501549)
I'm wondering, given a random truth-table with N binary variables and 1 binary output, what is (worst case) the smallest network that can learn it? (In terms of number of parameters).
[ Parent
| on HN ]
Re:A Neural Network in 11 Lines of Python (2015)
by fooker on Wednesday October 18, 2017 @03:07PM
(#15501990)
For a 100% success rate, it would have to be of the size of the minimal BDD.
If you can allow for some errors, this becomes an interesting problem.
Re:A Neural Network in 11 Lines of Python (2015)
by amelius on Wednesday October 18, 2017 @06:12PM
(#15503695)
Yes, but that's probably the theoretical minimum.
What I'm talking about is the size that is required so that the neural net can learn it. This may be different.
Re:A Neural Network in 11 Lines of Python (2015)
by HalcyonicStorm on Wednesday October 18, 2017 @03:29PM
(#15502167)
Can you define BDD, please?
Re:A Neural Network in 11 Lines of Python (2015)
by fnbr on Wednesday October 18, 2017 @05:31PM
(#15503351)
This is technically true, but I wonder how close you could get to 100% with minimal size. I would expect that you could get somewhere around >98% with a network that's a few megabytes in size.