Yes it does require you to send your model to Google: https://coral.withgoogle.com/web-compiler/
Weapons or other technologies whose principal purpose or implementation is to cause or directly facilitate injury to people.
https://www.blog.google/technology/ai/ai-principles/
But drones that spy on people are ok as long as they aren't "violating internationally accepted norms" which sort of sounds like a blank check.
Google should license this thing to someone else who can make it in good quantity and sell it really cheap, so others build it into their designs. I'd be pretty excited if that happened.
I'll wait for independent testing before I drop $100.
OTOH, fp32 models are _much_ easier to work with, and this thing has more RAM so you can waste it on 32 bit weights, and NVIDIA's software toolkit is second to none. So the Jetson looks pretty tempting as well. I just wish they didn't try to insult my intelligence.
When people start getting their hands on them I'll start seeing independent benches, and I think anandtech got their hands on one. Hopefully soon™.
Training is a slight win (although it's going to be too slow for anything useful really).
But it looks like the TPU will outperform this somewhat for inference. The 256 core Jetson (this has 128 cores) could run MobileNet-v2 at between 12 and 20 ms per image (depending on batch size)[1], while the USB TPU adapter takes 2.3ms per image [2]
Also, doesn't require you to send your model to their company.
Nor does the TPU dev board.
[1] https://arxiv.org/pdf/1810.00736.pdf (see table 1)
[2] https://coral.withgoogle.com/tutorials/edgetpu-faq/