Re:How to train large models on many GPUs?
by kkielhofner on Monday September 27, 2021 @09:42AM
(#28670530)
You can tweak the power limit settings for your application. In many cases you can drop the power consumption (and heat generated) while still maintaining > 90% performance but this will depend on your actual use case [0].
In my experience for many models you can reduce the power limit even further than what has been tested in this guide while barely impacting performance.
In my experience for many models you can reduce the power limit even further than what has been tested in this guide while barely impacting performance.
[0] https://timdettmers.com/2020/09/07/which-gpu-for-deep-learni...