News for hackers. Stuff that matters.
Re:Building your own deep learning computer is 10x cheaper t... by p1esk on Wednesday September 26, 2018 @01:07PM (#18078024)
Model parallelism is also useful in situation where your model (and/or your inputs) is so large that even with batch_size=1 it does not fit in GPU memory (especially if you're still using 1080Ti). However other techniques might help here (e.g. gradient checkpointing, or dropping parts of your graph to INT8).

There are no comments on this comment yet.