Re:Understanding Convolutional Neural Networks
by archerx on Friday July 03, 2020 @04:40AM
(#23722209)
Why doesn't it explain what the "bias" is?
[ Parent
| on HN ]
Re:Understanding Convolutional Neural Networks
by scarlac on Friday July 03, 2020 @01:41PM
(#23725897)
Neurons have weight and bias. Weight is multiplied, bias is added. Really that simple.
Here are examples of equivalent notations that may make it more familiar:
y = 2⋅x + b or
y = a⋅x + b
- x would be the input to the neuron, often named 'x'.- a/2 would be the weight, often named 'w'.
- b would be the bias, often named 'b'.
- y is the output.
In neural network documentation this is often written as (often case sensitive, which may be confusing): output = w⋅x + b (output = weight * input + bias).
I hope that explains it.
Re:Understanding Convolutional Neural Networks
by confuseshrink on Friday July 03, 2020 @04:49AM
(#23722252)
Bias is just a scalar term that is added. You can learn it via backpropagation like all the other weights.