There was a OpenCL branch no long ago that was supposed to make it into mainline at some point. You can (kinda) track progress of that here: https://github.com/tensorflow/tensorflow/issues/22