How fantastic.
https://github.com/plaidml/plaidml/tree/master/tile/hal
It's kind of cool to look anyway because it's a lot of value in less code than you might expect (complexity is in the layers above HAL).
If someone wanted to add support for Vulkan or something more ambitious like Qualcomm Hexagon or the RPi with QPU that would be pretty cool though.
TF removes the silicon from the equation. So if Nvidia cheaper use but if TPUs cheaper use. If something new that is cheaper then move. TF is the key.
I have done deep learning also and I don't see NVIDIA being an incumbent that is easy to be knocked out. I think we would need some distruption such as a new technique that is more performant or different design goals. Intel is still leading the way and I don't see NVIDIA being unseated with its head start anytime soon.
"Slowly grinds the mill of the gods, but it grinds fine."
Matrox didn't give much of a damn to 3D gaming, 3Dfx were bust doing all the wrong things. It was certainly not "easy", but don't seems hard or impossible either at the time.
ArrayMancer: https://mratsim.github.io/Arraymancer/
Written in Nim, which looks and feels a lot like Python, but runs a lot like C++ or Rust, especially in the speed and FFI departments, and deploys like Go as a small single fast executable. Already supports CPU, CUDA and OpenCL. Still early, but with a lot of promise. Use is modeled on some mixture of PyTorch and Keras.
NVIDIA is now exerting pricing power to the point where they’ve decided to train their sales people to disregard the metric that is most important to customers: cost of training. Talk with one of their enterprise sales people and you’ll find they’ll say things like “FLOPS / $ doesn’t matter” to justify a 10x increase in price for their TESLA line. As history has shown, a monopolist sows the seeds of their own destruction and, by disregarding the metrics that matter, they alienate their customers.
Here are open source projects that you can contribute to to break the monopoly:
ROCm: https://rocm.github.io/
MIOpen: https://github.com/ROCmSoftwarePlatform/MIOpen
TensorFlow: https://github.com/tensorflow/tensorflow