News for hackers. Stuff that matters.
Re:TensorFlow: open-source library for machine intelligence by elcritch on Monday November 09, 2015 @11:27AM (#10533924)
Agreed, this is huge. I've been thinking along these lines for a while, but more focused on traditional programming systems. The approach of programming via data-flows and visually representing those is going to be enormous in the coming decade, IMHO. Especially in asynchronous and heterogenous programming environments.

Actually, it feels like I've been "scooped" somewhat. However, at the same time it's awesome to find that many of the core assumptions I've been working in formulating for traditional programming systems are actually already being used by other top engineers/researchers at Google. Thanks for posting about the whos-who of systems research. I'll have to check up on their research more!

I think there is a lot of room left to apply this approach to a lot of existing systems outside of machine learning. We're working on releasing a prototype in the coming months at our new startup (vexpr.com) based on applying these same data-flow principles to normal programming projects. Actually this might give a huge boost in presenting the underlying approach to systems engineering to audiences.

Re:TensorFlow: open-source library for machine intelligence by cafebeen on Monday November 09, 2015 @10:22PM (#10537425)
I wouldn't worry too much about being scooped by this--the idea of data flow programming has been around since the 60s. Tensorflow looks like a very nice implementation of those ideas for neural network training, and is potentially useful for more general numerical computing, but to what extent remains to be seen.
Re:TensorFlow: open-source library for machine intelligence by w_t_payne on Monday November 09, 2015 @01:14PM (#10534694)
Yeah ... I'm a big fan of data-flow programming (Been working on my own approach for a little while too ...)
Re:TensorFlow: open-source library for machine intelligence by elcritch on Monday November 09, 2015 @06:45PM (#10536653)
Nice, lol, hope TensorFlow didn't scoop any of your ideas too. ;) Overall, it's exciting to see data-flow paradigms gain popularity.

What kind of dataflow approach are you most interested in? I've been shifting my approach to work within existing systems. One things I've been doing is abusing the intent of web-components and DOM events to create data visualization tools.

Recently my team and I decided to focus down a little more. Have you had success in bridging the gap between esoteric academic papers and industry?

Re:TensorFlow: open-source library for machine intelligence by w_t_payne on Monday November 09, 2015 @07:01PM (#10536714)
Nothing too serious ... mostly to glue embedded machine vision system components together in a simulation environment.
Re:TensorFlow: open-source library for machine intelligence by hmehta on Monday November 09, 2015 @07:56PM (#10536939)
Do you guys know of any theoretical analysis on Data flow vs Control flow software ?
Re:TensorFlow: open-source library for machine intelligence by kragen on Tuesday November 10, 2015 @10:21AM (#10539816)
This comment is not being answered, not because there is none, but because there is far too much to fit a good summary of it into this margin. It includes most of modern compiler and CPU design, as well as most current HPC work.
Re:TensorFlow: open-source library for machine intelligence by elcritch on Tuesday November 10, 2015 @02:10PM (#10541575)
That's a fair point overall. It's basically the entirety of the debate between functional languages and imperative languages. Nonetheless, it is still pretty good question as far as someone trying to understand the differences and why it might be useful.

@hmehta, one of my recent favorite videos generally on this topic has been from Curry On conference [1]. It's not strictly data-flow vs control flow, but it does discuss some of the more practical differences in between using monads for structuring data flows vs imperative control.

My take is that monads can be roughly considered as wrapping up imperative control flow along with the data. E.g. wrapping up the if/else choices into a data structure. Currently I actually found studying up on actual category theory easier than all the "easy introduction" things regarding monads. As in, the ideas when presented straightforwardly and technically correct are simpler than we give credence to.

[1]: https://www.youtube.com/watch?v=449j7oKQVkc