Re:Building your own deep learning computer is 10x cheaper t...
by p1esk on Wednesday September 26, 2018 @01:07PM
(#18078024)
Model parallelism is also useful in situation where your model (and/or your inputs) is so large that even with batch_size=1 it does not fit in GPU memory (especially if you're still using 1080Ti). However other techniques might help here (e.g. gradient checkpointing, or dropping parts of your graph to INT8).
[ Parent
| on HN ]
There are no comments on this comment yet.