News for hackers. Stuff that matters.

A comment on Tenstorrent Unveils High-End Wormhole AI Processors, Featuring RISC-V. Parent comment

Re:Tenstorrent Unveils High-End Wormhole AI Processors, Feat... by qeternity on Sunday July 21, 2024 @07:29AM (#41024306)
That is bs=32 which is wholly unimpressive. Last gen consumer cards can do better than this at similar power envelope. Current gen even better.
[ Parent | on HN ]
Re:Tenstorrent Unveils High-End Wormhole AI Processors, Feat... by inhumantsar on Sunday July 21, 2024 @10:34AM (#41025389)
do you have any benchmarks to share? the best I've seen for a 4090 are all in the mid-20s, never more than 30t/s.
[ Parent | on HN ]
Re:Tenstorrent Unveils High-End Wormhole AI Processors, Feat... by qeternity on Sunday July 21, 2024 @12:39PM (#41026251)
Where have you seen this? Look at what vLLM or TensorRT will do on a 4090 at those batch sizes.
[ Parent | on HN ]