News for hackers. Stuff that matters.
Re:XNOR.ai frees AI from the prison of the supercomputer by saycheese on Sunday January 22, 2017 @06:46PM (#13458455)
Thought that Google's TensorFlow already does this and has since shortly after it was released - what am I missing?

Example: https://www.tensorflow.org/mobile/

Re:XNOR.ai frees AI from the prison of the supercomputer by emcq on Sunday January 22, 2017 @11:53PM (#13459860)
XNOR-Net is not currently part of TensorFlow, although there is a feature request to support it. [0]

The main difference is that XNOR-Net uses 1 bit quantized weights and XNOR+popcount to approximate the dot product of convolution, which can be implemented very efficiently by using 64-bit arithmetic instructions on a CPU to operate over 64 1-bit components in parallel. [1]

TensorFlow's optimization is also using discretized weights, but AFAIK targeted at 8-bit quantized weights. [2]

[0] https://github.com/tensorflow/tensorflow/issues/1592

[1] https://arxiv.org/pdf/1603.05279v4.pdf

[2] https://petewarden.com/2015/05/23/why-are-eight-bits-enough-...

Re:XNOR.ai frees AI from the prison of the supercomputer by shpx on Sunday January 22, 2017 @07:22PM (#13458644)
I think this is their paper http://www.arxiv-sanity.com/1603.05279 and this is the (torch) code https://github.com/allenai/XNOR-Net

Cursory look suggests they quantize both the weights and functions during classification on the smart phone and during the forwards and backwards pass during training. But you still have to use a continuous version of your logic gate to get an error gradient during training, so I'm guessing they still do the training on "supercomputers" (a desktop with a gpu really).

Re:XNOR.ai frees AI from the prison of the supercomputer by hidden-markov on Sunday January 22, 2017 @07:21PM (#13458639)
TensorFlow supports weight quantization, but XNOR seems to be rewriting the trained model graph into a one that only uses binary boolean ops, and probably optimizing the graph along the way.
Re:XNOR.ai frees AI from the prison of the supercomputer by Houshalter on Sunday January 22, 2017 @07:25PM (#13458659)
That uses lower precision arithmetic. In this case they are reducing the precision to 1 bit, apparently.
Re:XNOR.ai frees AI from the prison of the supercomputer by arjo129 on Monday January 23, 2017 @02:05AM (#13460414)
TF is not the nicest thing to work with. It is still very computationally expensive to use on embedded hardware platforms.