News for hackers. Stuff that matters.
Re:How to train large models on many GPUs? by kkielhofner on Monday September 27, 2021 @09:42AM (#28670530)
You can tweak the power limit settings for your application. In many cases you can drop the power consumption (and heat generated) while still maintaining > 90% performance but this will depend on your actual use case [0].

In my experience for many models you can reduce the power limit even further than what has been tested in this guide while barely impacting performance.

[0] https://timdettmers.com/2020/09/07/which-gpu-for-deep-learni...

There are no comments on this comment yet.