Using LLaMA with M1 Mac and Python 3.11

Re:Using LLaMA with M1 Mac and Python 3.11 by zirgs on Sunday March 12, 2023 @02:15PM (#35123934)

https://github.com/oobabooga/text-generation-webui/wiki/LLaM... Here you go. You'll need a Nvidia GPU with at least 8 GB VRAM though.

[ Parent | on HN ]

Re:Using LLaMA with M1 Mac and Python 3.11 by mark_l_watson on Sunday March 12, 2023 @03:40PM (#35125162)

Thanks! I have a Linux laptop with 16G ram and a 10G NVidai 1070, so I might be good to go.

[ Parent | on HN ]

Re:Using LLaMA with M1 Mac and Python 3.11 by goldenCeasar on Sunday March 12, 2023 @09:00PM (#35129118)

Any examples on running on multiple GPUs?

[ Parent | on HN ]