Re:How to run Llama 13B with a 6GB graphics card
by mycall on Sunday May 14, 2023 @11:45PM
(#35943686)
You are missing the point. There are layers and the LLM is one layer (orchestration), but you can always have other semantic kernels with skills connected to other software (do stuff).
[ Parent
| on HN ]
Re:How to run Llama 13B with a 6GB graphics card
by ehnto on Monday May 15, 2023 @06:20AM
(#35945961)
That is exciting to me, if a little scary. A home-AI or business-AI running entirely in house for privacy and security reasons. That is technically possible right now, but perhaps practically a little bit down the road yet.