ymt123

Re:Ctop – commandline monitoring for containers on Thursday March 09, 2017 @06:25PM (#13834834)

I'm a fan of glances: https://nicolargo.github.io/glances/

Re:Infrastructure for Deep Learning on Tuesday August 30, 2016 @02:03PM (#12392371)

Have you tried Sacred[1]? It definitely doesn't answer the "infrastructure for deep learning" challenge but it is helpful for understanding what experiments have been run/where did this model come from (including what version of the code/parameters produced it)

[1] https://github.com/IDSIA/sacred

Re:Infrastructure for Deep Learning on Tuesday August 30, 2016 @01:45PM (#12392209)

It's great to see people talking about the infrastructure they use to manage their deep learning workloads.

One area where we've had trouble with other orchestration tools (e.g. Docker Swarm) was in managing resources at anything beyond whole boxes. They are all good at managing CPU/RAM/Disk but we've had trouble with give this task GPU2. We had planned to try Mesos (given that we already run it for other things) but it sounds like maybe we should take a harder look at Kubernetes first.

Imagenet for Space

Posted by ymt123 on Thursday August 25, 2016 @06:48PM
from the techcrunch.com dept.

https://techcrunch.com/2016/08/25/spacenet-satellite-imagery-repository-launched-by-digitalglobe-cosmiq-works-and-nvidia-on-aws/

( Read More... | no comments | 4 points | on HN )

Re:A Container Is a Function Call on Monday August 15, 2016 @11:14AM (#12290980)

If I'm understanding correctly that sounds similar to Pachyderm (http://www.pachyderm.io)

Re:Lesser-Known Python Data Analysis Libraries on Tuesday April 19, 2016 @11:13AM (#11527537)

It's not quite the same (since it doesn't become a Map-Reduce job) but if you're mostly interested in the programming paradigm/scalability the Python API for Apache Spark might be a good alternative

Re:Docker 1.10.0 is out on Friday February 05, 2016 @06:43AM (#11040824)

I think this was the problem [1] was targeting [1] http://engineeringblog.yelp.com/2016/01/dumb-init-an-init-fo...

Re:Colorizing black and white photos with deep learning on Friday January 08, 2016 @01:34PM (#10867064)

There are actually dockerized versions of many (maybe all) of the deep learning libraries. The docker containers can take advantage of the GPU for training. You still have to install CUDA on the box (outside the docker container) but then you can try out different deep learning libraries.

Libraries we've started from in my lab: Caffe: https://hub.docker.com/r/kaixhin/caffe/ Torch :https://hub.docker.com/r/kaixhin/torch/ Theano: https://hub.docker.com/r/kaixhin/theano/