News for hackers. Stuff that matters.
Re:Paving the way to efficient architectures: StripedHyena-7B by senseiV on Friday December 08, 2023 @08:19PM (#38577287)
V5 7b is out, close to hyena, gets 1400 t/s on a 3090, while an h100 llama 7b 8bit is 1200 t/s

There are no comments on this comment yet.