News for hackers. Stuff that matters.
Re:Effective Tensorflow by jjawssd on Sunday August 13, 2017 @03:39PM (#15004516)
Tensorflow is more documented and talked about right now which is why more people will be interested in it
Re:Effective Tensorflow by 0xbear on Sunday August 13, 2017 @03:51PM (#15004584)
I'm not actually sure it's "more documented". It has more documentation, that's true, but that's not the same thing as better documentation, and after some point the mountain of documentation becomes a daunting obstacle. TF IMO is far beyond that point.
Re:Effective Tensorflow by p1esk on Sunday August 13, 2017 @06:09PM (#15005224)
TF documentation is excellent. PyTorch, on the other hand, felt like almost entirely undocumented. A month ago I tried to implement something fairly trivial (Karpathy's character RNN model), and there was no documentation at all on how to run it on multiple GPUs. I had to go through unrelated models code to understand how this could be done (using external library DataParallel). This might have improved since.

Also compare the number of TF and PT questions on SO.

Re:Effective Tensorflow by SimbaOnSteroids on Sunday August 13, 2017 @04:28PM (#15004771)
I find the documentation daunting but I had assumed that was because I didn't really understand how AI works and that as my understanding grew the docs would start to make more sense.
Re:Effective Tensorflow by 0xbear on Sunday August 13, 2017 @05:00PM (#15004901)
Take a look at PyTorch. Much easier to understand, fewer bugs, much less obscure all around. I've spent years working with TF and have come to dislike its inflexible, verbose, and convoluted way of doing things. I'm 80% on PyTorch now.
Re:Effective Tensorflow by mamp on Sunday August 13, 2017 @06:27PM (#15005310)
> I've spent years working with TF

Ha, TF was only released in Nov 2015 but sitting around waiting for networks to finish training makes it feel longer than that!

Re:Effective Tensorflow by 0xbear on Sunday August 13, 2017 @08:49PM (#15005960)
I worked with it _before_ it was released, and with DistBelief before that. For a long time I considered TF to be the best option for the class of problems I work on. I was also extremely skeptical of PyTorch, but it won me over. Now that I'm no longer on a steady diet of Google Kool-Aid, I have the luxury of picking the best tool for the job. For a number of things that tool is made by Google (protocol buffers, gtest, gmock, grpc, some other things). But not for ML.
Re:Effective Tensorflow by mamp on Monday August 14, 2017 @06:48AM (#15007748)
Based on your experience I'll definitely give PyTorch a go. Thanks.
Re:Effective Tensorflow by Q6T46nT668w6i3m on Sunday August 13, 2017 @05:42PM (#15005123)
I like and use both PyTorch and TensorFlow. You’re entirely correct that TensorFlow is far more verbose than PyTorch, but Keras remedies this (for many problems). I’d also add that PyTorch has a narrower scope than PyTorch and because of this introduces problems when scaling or distributing (PyTorch’s flexible broadcasting isn’t without trade-offs). Maybe there’ll be a convergence of Caffe 2 and PyTorch to remedy that problem.
Re:Effective Tensorflow by dr1337 on Sunday August 13, 2017 @06:25PM (#15005292)
For me, Keras is the least verbose of Tensorflow and PyTorch, however I find it too sparse and there's too much "magic" happening under the nicely done API. I have found PyTorch to be the happy half-way point between Tensorflow and Keras in terms of verbosity.
Re:Effective Tensorflow by Q6T46nT668w6i3m on Sunday August 13, 2017 @06:31PM (#15005327)
I’m curious, what parts do you find too magical? I’ve been trying to help with this problem (clarifying or surfacing features that are too magical without relinquishing Keras’ commitment to “convention over configuration”), so your (or others) feedback is welcome!