Re:Grid: AI platform from the makers of PyTorch Lightning
by wfalcon on Thursday October 08, 2020 @05:30PM
(#24724140)
we highlight these issues in our docs explicitly.
https://pytorch-lightning.readthedocs.io/en/latest/tpu.html#...
Re:Grid: AI platform from the makers of PyTorch Lightning
by marcinzm on Thursday October 08, 2020 @05:53PM
(#24724321)
Can you point out where exactly in those docs you highlight the issue?
I just read the linked page and found no references to data loading limitations or performance limitations. Is it only in the video which isn't search indexed and few people would bother watching?
edit: The page literally advertises the speed of TPUs with "In general, a single TPU is about as fast as 5 V100 GPUs!" which is the exact opposite of warning people.
I have great respect for the PyTorch-TPU team, but I would recommend not heavily advertising PyTorch-TPU support until this major feature disparity is made up.