Re:A new GPU backend for the TVM stack
by microcolonel on Monday October 30, 2017 @03:01PM
(#15587898)
Vega has half-precision floats as well though, which (with a seemingly negligible loss in precision) in combination with their HBCC (transparent main memory DMA) should more than make up for the lack of memory on the Vega 64, and in the case of Frontier Edition, all the more so.
Vega is meant to have someting called HBCC - that effectively allows you to use system RAM or even SSD as GPU memory for VERY large datasets. I have no idea if it would be fast enough for deep learning workloads over PCIe
https://www.pcper.com/news/General-Tech/AMDs-HBCC-you-and-me
That's a fair assumption I think. It will be interesting to see whether Vega's high-bandwidth cache controller (HBCC) will help nullify this difference if implemented in ML frameworks.
A better comparison is probably Vega Frontier with 16GB of RAM for $1000. If you're doing heavy compute, you're probably gonna need a ton of RAM to go with it.