Re:AMD MI300x GPUs with GEMM tuning improves throughput and ...
by fancyfredbot on Saturday June 29, 2024 @02:14PM
(#40832455)
I noticed column G is always 2x column E. So I think they are counting both input and output tokens in the throughput for G but not for E.
There's only one Google doc and you are linking to the same one I mentioned and the same one in the article... Not sure why you only see latency - there's definitely a throughput tab too.
There's only one Google doc and you are linking to the same one I mentioned and the same one in the article... Not sure why you only see latency - there's definitely a throughput tab too.