Re:Matrix multiplication inches closer to mythic goal
by shaklee3 on Wednesday March 24, 2021 @01:08AM
(#26563820)
This is not true. What is your source?
[ Parent
| on HN ]
Re:Matrix multiplication inches closer to mythic goal
by antixk on Wednesday March 24, 2021 @03:52AM
(#26564568)
I guess OP meant that each tensor core in the latest NVIDIA GPUs fundamentaly performs 4x4 matrix multiplication [0].
[0] https://nla-group.org/2020/07/21/numerical-behaviour-of-tens...
Re:Matrix multiplication inches closer to mythic goal
by shaklee3 on Wednesday March 24, 2021 @09:17AM
(#26566786)
That's also not true. They do 4x4, 8x8, and 16x16.
Re:Matrix multiplication inches closer to mythic goal
by AnotherGoodName on Wednesday March 24, 2021 @01:21PM
(#26570203)
Which is fine for the point being made here. There's no issue with n^3 for small matrices.