News for hackers. Stuff that matters.
Re:Researchers run high-performing LLM on the energy needed ... by shivaluminaire on Monday July 01, 2024 @02:48PM (#40849036)
When you multiply by 64 you also get 64 times more tokens per second!! Your math is wrong.
Re:Researchers run high-performing LLM on the energy needed ... by shivaluminaire on Monday July 01, 2024 @02:49PM (#40849050)
When you multiply by 64 you also get 64 times more tokens per second!! Your math is wrong.
Re:Researchers run high-performing LLM on the energy needed ... by pbnjay on Wednesday July 10, 2024 @11:44AM (#40928200)
That's their math, the 23.8t/s is already the 64x but they didn't 64x the other stats.