If you just want to use it, there’s a Python SDK which you can use to run a subset of models popular frameworks can train. In that case it’s pretty easy to get going. I believe there’s also a C++ integration of some sort, but I haven’t used it myself.
It’s all moot, though, because properly programmed, recent ARM CPUs are fast enough to run usable models such as MobileNet and ShuffleNet with good performance. The problem is that at the moment this draws anywhere between 4-12W if things are running full blast, at least until throttling kicks in. Movidius is more economical in terms of joules per inference, but it also costs quite a bit, and it’s not built in, so market penetration is non-existent.
As I mentioned, though, this should start being less of an issue with the advent of cheap, built in tensor acceleration IP.
I was, frankly, surprised by the technical depth of what they were able to put together.
Of course it has high bandwidth, it's a multi bank on chip memory...
And yes, I've seen all public (and some non public) information on their architecture