Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Tenstorrent Unveils High-End Wormhole AI Processors, Featuring RISC-V. Parent comment
An N300 costs $1400 and does 350 t/s on Mistral 7B at bs=32. For $1000 you can buy a 3090 that will do 10x that.
There are no comments on this comment yet.
An N300 costs $1400 and does 350 t/s on Mistral 7B at bs=32. For $1000 you can buy a 3090 that will do 10x that.