News for hackers. Stuff that matters.

A comment on Nvidia-Docker – Build and Run Docker Containers Leveraging Nvidia GPUs. Parent comment

Re:Nvidia-Docker – Build and Run Docker Containers Leveragin... by etaioinshrdlu on Friday August 18, 2017 @01:43PM (#15048204)
Is it possible that the slowness is caused by disk speed of loading a large file from disk?

I've observed the same thing but it seemed to be IO related, not CPU or GPU related.

[ Parent | on HN ]
Re:Nvidia-Docker – Build and Run Docker Containers Leveragin... by tlb on Friday August 18, 2017 @02:28PM (#15048585)
It's mainly the speed of creating a huge number of small files on disk. When unpacking a docker image into an AUFS file system, it has to create every file in the shadow system. A robust Ubuntu install has around 100000 files. On AWS with default EBS storage, this can take a few minutes. At OpenAI we pre-built AMI instances with file systems pre-unpacked.
[ Parent | on HN ]