News for hackers. Stuff that matters.
Re:70B Llama 2 at 35tokens/second on 4090 by Palmik on Wednesday September 13, 2023 @03:21PM (#37500558)
Yes, and that's great, but what I meant is that it can definitely be much cheaper still, especially if you do not need a model that needs to be able to do everything, but is specialized on one or a few use cases.

There are no comments on this comment yet.