News for hackers. Stuff that matters.
Re:Facebook LLAMA is being openly distributed via torrents by markasoftware on Saturday March 04, 2023 @12:50AM (#35018559)
Perhaps try setting `OMP_NUM_THREADS`, for example `OMP_NUM_THREADS=4 torchrun ...`.

But on my machine, it automatically used all 12 available physical cores. Setting OMP_NUM_THREADS=2 for example lets me decrease the number of cores being used, but increasing it to try and use all 24 logical threads has no effect. YMMV.

There are no comments on this comment yet.