Re:Facebook LLAMA is being openly distributed via torrents
by jpieper on Friday March 03, 2023 @10:32PM
(#35017881)
Beginner pytorch user here... it looks like it is using only one CPU on my machine. Is it feasible to use more than one? If so, what options/env vars/code change are necessary?
[ Parent
| on HN ]
Re:Facebook LLAMA is being openly distributed via torrents
by markasoftware on Saturday March 04, 2023 @12:50AM
(#35018559)
Perhaps try setting `OMP_NUM_THREADS`, for example `OMP_NUM_THREADS=4 torchrun ...`.
But on my machine, it automatically used all 12 available physical cores. Setting OMP_NUM_THREADS=2 for example lets me decrease the number of cores being used, but increasing it to try and use all 24 logical threads has no effect. YMMV.