Of course, for inferencing assuming >100 TFlops on float 16 and >400 TOPS in INT4 as demoed by Jenson would be awesome for already trained/pruned models. Though for training I am not so sure, even V100 have rough edges in doing that with TensorFlow. And for model size - I guess it all depends on area in which are you are focusing; I run out of memory all the time these days even with batches of size 1 :(