Limits on Matrix Multiplication

Re:Limits on Matrix Multiplication by abecedarius on Saturday September 01, 2018 @10:47AM (#17892074)

I'm not sure quite what you mean, but you can do the linear part of one layer all together, then the nonlinear part, etc.:

    for weight,bias in layers:
        a = sigmoid(np.dot(weight, a) + bias)

[ Parent | on HN ]

Re:Limits on Matrix Multiplication by taeric on Saturday September 01, 2018 @11:23AM (#17892234)

So my question is how large is the linear part? Granted, I was hoping it was big enough to bring these algorithms into consideration. Looks like I'm right in that they are larger than 2x2. However, they are still not 8kx8k. :(

[ Parent | on HN ]

Re:Limits on Matrix Multiplication by abecedarius on Saturday September 01, 2018 @01:34PM (#17892945)

They can be pretty big! I don't know what's normal these days, though.

[ Parent | on HN ]