News for hackers. Stuff that matters.
Re:GPT-4 Details Leaked by schappim on Tuesday July 11, 2023 @07:26PM (#36688529)
It is not too bad, 7B is doing 432 tokens per second on a Macbook[1].

[1] Video: https://huggingface.co/datasets/huggingface/documentation-im...

There are no comments on this comment yet.