News for hackers. Stuff that matters.

A comment on The Matrix Calculus You Need for Deep Learning. Parent comment

Re:The Matrix Calculus You Need for Deep Learning by mrfox321 on Monday July 31, 2023 @01:37PM (#36946113)
Re [1]: it's fairly concrete to simply say that matrix multiplication can be performed block-wise.
[ Parent | on HN ]
Re:The Matrix Calculus You Need for Deep Learning by PartiallyTyped on Monday July 31, 2023 @02:25PM (#36946777)
I don’t disagree; but that is just an example of MM. The gist is not that you can do block multiplication; but that you can define matrices over any valid ring, which includes other matrices - ie blocks.
[ Parent | on HN ]
Re:The Matrix Calculus You Need for Deep Learning by mrfox321 on Monday July 31, 2023 @03:20PM (#36947501)
Yeah matrices are more abstract. I guess I am just pointing out that your concrete example of non-commutative rings (matrices of matrices) still needs a proof to demonstrate bijection between 4N x 4N (scalar) and 4 x 4 (N x N(scalar)).

Block MM demonstrates the equivalence.

[ Parent | on HN ]