Re:Llama.cpp 30B runs with only 6GB of RAM now
by fallous on Friday March 31, 2023 @07:47PM
(#35395341)
The professional operates within prioritization tranches. Make it work, make it reliable, make it fast, make it pretty. If you're still iterating on proof-of-concept/prototyping you'll generally confine yourself to the first and/or second levels. Once you've settled on a finalized prototype you then follow the rest of the prioritization levels to achieve shippable product.
[ Parent
| on HN ]
There are no comments on this comment yet.