News for hackers. Stuff that matters.

A comment on Tenstorrent Unveils High-End Wormhole AI Processors, Featuring RISC-V. Parent comment

Re:Tenstorrent Unveils High-End Wormhole AI Processors, Feat... by inhumantsar on Sunday July 21, 2024 @10:34AM (#41025389)
do you have any benchmarks to share? the best I've seen for a 4090 are all in the mid-20s, never more than 30t/s.
[ Parent | on HN ]
Re:Tenstorrent Unveils High-End Wormhole AI Processors, Feat... by qeternity on Sunday July 21, 2024 @12:39PM (#41026251)
Where have you seen this? Look at what vLLM or TensorRT will do on a 4090 at those batch sizes.
[ Parent | on HN ]