News for hackers. Stuff that matters.
Re:Deep Learning with Spark and TensorFlow by orm on Monday January 25, 2016 @05:40PM (#10970567)
I think one reason would fault tolerance. Is there a fault tolerance layer in GNU parallel? last time I checked their homepage ( a few minutes ago), there was no reference to fault tolerance.

Another reason is, perhaps, scheduling.

Re:Deep Learning with Spark and TensorFlow by chimtim on Monday January 25, 2016 @09:32PM (#10971522)
what fault tolerance does spark give you in this scheme? It cannot look into TF progress and checkpoint all state. Using Spark with TF, seems like an overkill -- you need to manage and install two framework what should ideally be a 200 line python wrapper or small mesos framework at most.
Re:Deep Learning with Spark and TensorFlow by ole_tange on Tuesday January 26, 2016 @02:43AM (#10972330)
Does --retries count as fault tolerance?