News for hackers. Stuff that matters.

A comment on 70B Llama 2 at 35tokens/second on 4090. Parent comment

Re:70B Llama 2 at 35tokens/second on 4090 by quickthrower2 on Wednesday September 13, 2023 @07:07PM (#37502859)
Ha ha not sure yet, I have only done it from the command line. Still got a lot to learn. Building something like this will be good for that!
[ Parent | on HN ]

There are no comments on this comment yet.