By the way, the last author of the TCN paper (Vladlen Koltun) works at Intel Labs (Intelligent Systems Lab).
So does this not work if you don’t have fancy new intel hardware?
Hi. I’m one of the authors of the library.
The models work on every popular CPU by Intel.
Nonetheless, we’re supporting Intel Optimzed Tensorflow when installing and in the future plan to add HW optimizations to the models.
Stay tuned :)
Re:NLP Architect by Intel AI Lab
by stochastic_monk on Thursday January 10, 2019 @01:42PM
(#18876605)
So this is aimed at inference rather than training. Does Intel have any plans to produce chips which can scale training as well, or is that largely going to be outsourced to GPUs for models of considerable size for the time being?
I imagine models need to be deployed more often than built, but I thought that the pain point was usually the latter.
The Intel AI Lab has an introduction to NLP (https://ai.intel.com/deep-learning-foundations-to-enable-nat...) and optimized Tensorflow (https://ai.intel.com/tensorflow/)
One surprising research result for this NLP is that a simple convolutional architecture outperforms canonical recurrent networks, often. See: CMU lab, Sequence Modeling Benchmarks and Temporal Convolutional Networks (TCN) https://github.com/locuslab/TCN
If you're interested in Nervana, here are some specifics: the chip is for hardware neural network acceleration, for inference-based workloads. Notable features include fixed-point math, Ice Lake cores, 10-nanometer fabs, on-chip memory management by software directly, and hardware-optimized inter-chip parallelism.
I've worked for Intel, and I'm stoked to see the AI NLP progress.