News for hackers. Stuff that matters.
Re:Apple: Transformer architecture optimized for Apple Silicon by mlboss on Thursday March 23, 2023 @07:26PM (#35282972)
LLaMA already runs on M2 and is comparable to gpt 3
Re:Apple: Transformer architecture optimized for Apple Silicon by crooked-v on Friday March 24, 2023 @07:43AM (#35287755)
I gave a try at Alpaca-LoRA with tloen's tuning and it definitely feels in reach of GPT 3. Not quite as good, but some of that may just be in whatever's going on with OpenAI's hidden prompts encouraging lots of text out of the model.