News for hackers. Stuff that matters.
Re:A comprehensive guide to running Llama 2 locally by shortrounddev2 on Wednesday July 26, 2023 @11:28AM (#36879358)
The cmake build prints that it finds cuda when I run the cmakelists (prints the location of cuda headers), however I dont see any noticeable difference between cpu-only and cuda builds. So if its not working then maybe there a CLI option thats required, or maybe cuda support is broken on windows

There are no comments on this comment yet.