News for hackers. Stuff that matters.
Re:PyTorch 1.5 by rrss on Wednesday April 22, 2020 @10:29AM (#22945931)
cuDNN converts to NHWC for 'tensor core' operations, so if the tensors are already in NHWC you can avoid the conversion.

See https://docs.nvidia.com/deeplearning/sdk/cudnn-developer-gui...

EDIT: I think https://github.com/pytorch/pytorch/issues/19092 is the RFC for this feature, and it has some more discussion.

There are no comments on this comment yet.