Re:A comprehensive guide to running Llama 2 locally
by shortrounddev2 on Wednesday July 26, 2023 @11:28AM
(#36879358)
The cmake build prints that it finds cuda when I run the cmakelists (prints the location of cuda headers), however I dont see any noticeable difference between cpu-only and cuda builds. So if its not working then maybe there a CLI option thats required, or maybe cuda support is broken on windows
[ Parent
| on HN ]
There are no comments on this comment yet.