News for hackers. Stuff that matters.

A comment on Matrix multiplication inches closer to mythic goal. Parent comment

Re:Matrix multiplication inches closer to mythic goal by antixk on Wednesday March 24, 2021 @03:52AM (#26564568)
I guess OP meant that each tensor core in the latest NVIDIA GPUs fundamentaly performs 4x4 matrix multiplication [0].

[0] https://nla-group.org/2020/07/21/numerical-behaviour-of-tens...

[ Parent | on HN ]
Re:Matrix multiplication inches closer to mythic goal by shaklee3 on Wednesday March 24, 2021 @09:17AM (#26566786)
That's also not true. They do 4x4, 8x8, and 16x16.
[ Parent | on HN ]
Re:Matrix multiplication inches closer to mythic goal by AnotherGoodName on Wednesday March 24, 2021 @01:21PM (#26570203)
Which is fine for the point being made here. There's no issue with n^3 for small matrices.
[ Parent | on HN ]