Re:DeepLearning11: 10x Nvidia GTX 1080 Ti Single Root Deep L...
by dharma1 on Monday October 30, 2017 @02:52PM
(#15587820)
Yeah, will be interesting to see if they can bring the price of GPUs with tensor cores down, from what I've read it's too expensive to make them right now for consumer market.
BTW - do you happen to know what DL frameworks currently support mixed precision training with Volta tensor cores? Curious to see if AWS V100 instances can really do 120 TFLOPS as advertised. I think latest versions of CUDA/CuDNN support Volta now?
That said, at Vega's 26 or so FP16 TFLOPS, it wouldn't be hard for NVIDIA to release a GeForce Volta with 30-40 tensor core TFLOPS, that both stomped on Vega and remained significantly inferior to V100. Given how hard it is to program Volta optimally, I'm surprised they haven't done so already, if only as a Titan XV Edition that can only be purchased from their website.