News for hackers. Stuff that matters.
Re:MXNet – Deep Learning Framework of Choice at AWS by cs702 on Tuesday November 22, 2016 @02:55PM (#13017046)
Translation from corporatespeak: "We don't have an internally developed framework that can compete with TensorFlow, which is controlled by Google, so we are throwing our weight behind MXNet."

As others have commented here, there is no evidence that MXNet is that much better (or worse) than the other frameworks.

Re:MXNet – Deep Learning Framework of Choice at AWS by eva1984 on Tuesday November 22, 2016 @05:04PM (#13018081)
Exactly. Among those DL frameworks, I think what TensorFlow gets right the most is the tooling support. The metric collection/visualization/checkpointing is plug-and-play in TensorFlow, others not too much. For example, summary a.k.a metric collection is just a subgraph of the whole computational graph, which can be evaluated at any time. A simple and neat abstraction indeed.

Those properties combined make TensorFlow the most engineer/practitioner friendly choice in the market. If AWS hopes to compete with TensorFlow in all seriousness, they need to catch up with support on those seeming trivial but important details.

Re:MXNet – Deep Learning Framework of Choice at AWS by werner on Tuesday November 22, 2016 @03:28PM (#13017366)
Amazon has been building technology based on ML&DL for over 20 years and has developed several frameworks. You must have missed the announcement of this open source framework earlier in the year: https://github.com/amznlabs/amazon-dsstne.
Re:MXNet – Deep Learning Framework of Choice at AWS by cs702 on Tuesday November 22, 2016 @03:47PM (#13017506)
I saw that when it was announced. DSSTNE has failed to capture the hearts and minds of developers. In my experience, it doesn't come up in any conversations about which frameworks to bet on for new product development.

And I'm rooting for Amazon (and FaceBook, and Microsoft...). TensorFlow needs competition for the hearts and minds of developers.

Re:MXNet – Deep Learning Framework of Choice at AWS by nate_martin on Wednesday November 23, 2016 @02:27PM (#13025080)
This doesn't address the root comment at all. Does Amazon actually think MXNet is the best? Or did they simply choose the next best thing that isn't already backed by another "big four" company (Google -> TensorFlow, Facebook -> Torch). It's hard to believe this is actually about scalability without any data.
Re:MXNet – Deep Learning Framework of Choice at AWS by julsimon on Wednesday November 23, 2016 @03:43AM (#13021135)
Here is a very nice blog article explaining how Amazon is generating recommendations at scale with Apache Spark and Amazon DSSTNE :) https://aws.amazon.com/blogs/big-data/generating-recommendat...
Re:MXNet – Deep Learning Framework of Choice at AWS by ogrisel on Tuesday November 22, 2016 @03:20PM (#13017297)
At least MXNet is a good one that deserves more publicity and backing (in terms of maintenance effort). I find it better for the community to have AWS back a good existing open source project than to re-invent a very similar wheel one more time.
Re:MXNet – Deep Learning Framework of Choice at AWS by cs702 on Tuesday November 22, 2016 @03:41PM (#13017459)
I like MXNet, and I think it's great that Amazon is backing it publicly. TensorFlow needs competition for the minds and hearts of developers.
Re:MXNet – Deep Learning Framework of Choice at AWS by antinucleon on Tuesday November 22, 2016 @06:08PM (#13018491)
There is a huge distributed performance advantages vs TensorFlow. You can get a hint from Prof. Carlos Guestrin's keynote talk at Data Science Summit 2016. Also, CMU CS Dean Andrew Moore cited MXNet as "is the most scalable framework for deep learning I have seen"
Re:MXNet – Deep Learning Framework of Choice at AWS by wicke on Tuesday November 22, 2016 @08:02PM (#13019079)
This recent OSDI paper [1] has a direct comparison in Fig 8. It appears there is no particularly pronounced distribution or general performance advantage, and TensorFlow actually outperforms MXNet in this comparison.

1: https://www.usenix.org/system/files/conference/osdi16/osdi16...

[full disclosure, I work on the TensorFlow team]

Re:MXNet – Deep Learning Framework of Choice at AWS by antinucleon on Wednesday November 23, 2016 @12:34AM (#13020349)
The version tested in paper should not have P2P,so it was much slower than current version.