News for hackers. Stuff that matters.
Re:AMD MI300x GPUs with GEMM tuning improves throughput and ... by fancyfredbot on Saturday June 29, 2024 @02:14PM (#40832455)
I noticed column G is always 2x column E. So I think they are counting both input and output tokens in the throughput for G but not for E.

There's only one Google doc and you are linking to the same one I mentioned and the same one in the article... Not sure why you only see latency - there's definitely a throughput tab too.

Re:AMD MI300x GPUs with GEMM tuning improves throughput and ... by qeternity on Saturday June 29, 2024 @02:17PM (#40832469)
It's not though, it's close, but it's not.

E18 is 527.75. 2 * 527.75 = 1055.5.

G18 is 1053.16.

So yeah, I have no idea.