salykova
Matrix Core Programming on AMD GPUs
Matrix Core Programming on AMD CDNA Architecture
Matrix Core Programming on AMD GPUs
Matrix Core Programming on AMD CDNA3 and CDNA4 Architecture
Matrix Core Programming on AMD CDNA3 and CDNA4 Architecture
Re:Beating NumPy matrix multiplication in 150 lines of C
on Thursday July 04, 2024 @01:11PM (#40876469)
excalidraw <3
Re:Beating NumPy matrix multiplication in 150 lines of C
on Thursday July 04, 2024 @12:08PM (#40875968)
as we discussed earlier, the code really needs Clang to attain high performance
Re:Beating NumPy matrix multiplication in 150 lines of C
on Thursday July 04, 2024 @04:20AM (#40873272)
"off-topic" channel
Re:Beating NumPy matrix multiplication in 150 lines of C
on Thursday July 04, 2024 @01:59AM (#40872654)
We were actively chatting with Justine yesterday, seems like the implementation is at least 2x faster than tinyBLAS on her workstation. The whole discussion is in Mozilla AI discord: https://discord.com/invite/NSnjHmT5xY
Re:Beating NumPy matrix multiplication in 150 lines of C
on Thursday July 04, 2024 @01:52AM (#40872620)
Hi! I'm the author of the article. It's my really first time optimizing C code and using intrinsics, so I'm definitely not an expert in this area, but Im willing to learn more! Many thanks for your feedback; I truly appreciate comments that provide new perspectives.
Regarding "creating a constant global array and loading from it" - if I recall correctly, I've tested this approach and it was a bit slower than bit mask shifting. But let me re-test this to be 100% sure.
"Comparing a constant vector {0, 1, 2, 3, 4, ...} with broadcasted m and m-8" - good idea, I will try it!