News for hackers. Stuff that matters.

A comment on LLaMA-7B in Pure C++ with full Apple Silicon support.

Re:LLaMA-7B in Pure C++ with full Apple Silicon support by tantony on Friday March 10, 2023 @10:39PM (#35104992)
This is pretty cool. I got it working in about 5 minutes. Inference of the 7B model is super fast. I don't know enough about prompting plain GPT models though.
[ Parent | on HN ]

There are no comments on this comment yet.