Automate deep learning training with Kubernetes GPU-cluster

Re:Automate deep learning training with Kubernetes GPU-cluster by shusson on Sunday June 11, 2017 @12:31AM (#14530646)

If the author is going to use GCP why not use their `container engine` [1]?

[1] https://cloud.google.com/container-engine/

[ Parent | on HN ]

Re:Automate deep learning training with Kubernetes GPU-cluster by boulos on Sunday June 11, 2017 @02:09AM (#14530890)

You can't load your own kernel modules (or generally bring your own base image) with Container Engine, and that includes NVIDIA's driver (nvidia.ko). We can't distribute nvidia.ko because the linked artifact is ultimately GPLv2 (like any Linux kernel module).

Given the above, today your only option is DIY.

Disclaimer: I work on Google Cloud, but IANAL.

[ Parent | on HN ]

Re:Automate deep learning training with Kubernetes GPU-cluster by Eridrus on Sunday June 11, 2017 @06:45AM (#14531479)

I know you said you're not a lawyer, but.... Linux is GPLv2, right? So why is it ok to distribute Linux, but not the NVIDIA driver?

[ Parent | on HN ]

Re:Automate deep learning training with Kubernetes GPU-cluster by boulos on Sunday June 11, 2017 @04:17PM (#14533559)

You can distribute GPL things if you make the source available. The source for Linux is freely available. The source for NVIDIA's entire driver is not (the shim layer that actually interacts with Linux does have the source code in the .run file, that's how you build it yourself).

[ Parent | on HN ]

Re:Automate deep learning training with Kubernetes GPU-cluster by Eridrus on Sunday June 11, 2017 @06:19PM (#14534109)

God this makes so little sense.

[ Parent | on HN ]

Re:Automate deep learning training with Kubernetes GPU-cluster by 220 on Sunday June 11, 2017 @10:10AM (#14532002)

Do y'all have any way of tracking feature for custom images and machine types for GCP?

Cloud ML feels not nearly ready, and but being able to do something like this on GKE would be magical.

[ Parent | on HN ]

Re:Automate deep learning training with Kubernetes GPU-cluster by shusson on Sunday June 11, 2017 @02:16AM (#14530904)

thanks, that's good to know.

[ Parent | on HN ]