News for hackers. Stuff that matters.
Re:Run More Stuff in Docker by peteretep on Saturday December 26, 2020 @08:06PM (#25547883)
wtf are you doing to create such large Docker containers? Are you installing each app on top of a fully-fledged Ubuntu? Are you leaving the build tools in the final container?
Re:Run More Stuff in Docker by fantod on Saturday December 26, 2020 @08:58PM (#25548172)
I mean it could just be very many containers that add up. And in many cases you'll have loads of images close to 1GB unless you go to great lengths to try and shrink them (e.g. anything that uses Python).
Re:Run More Stuff in Docker by peteretep on Saturday December 26, 2020 @09:07PM (#25548210)
I can get an Alpine Linux container running Perl with a chunk of CPAN on it to 60MB by just stripping the build tools once I've installed everything I want. Is Python really a GB bigger, or are people not taking the most basic of steps?
Re:Run More Stuff in Docker by tomrod on Sunday December 27, 2020 @12:11AM (#25549028)
Basic steps. Welcome to the long September of Docker. Whereas most folks who use it regularly know basic maintenance patterns, new users (myself included) must wade through inscrutable documentation or (worse) poorly written blogfarm posts in order to bootstrap up to a level of proficiency that passes interview smell tests.
Re:Run More Stuff in Docker by pferde on Sunday December 27, 2020 @06:10AM (#25550271)
Do you have any documentation (or blogs) on a higher level that you would recommend? I too have been using Docker for a while, and recently also for certain programs on my desktop (mainly firefox, github cli, azure cli, aws cli, terraform).

I like to think I am somewhat proficient in using Docker correctly by now, but I am still discovering new tidbits of practical knowledge, tips and good practices every few weeks. And I always want more. :)

Re:Run More Stuff in Docker by fantod on Sunday December 27, 2020 @11:31AM (#25552095)
Itamar Turner-Trauring's blog has a number of good articles on Docker best practices:

https://pythonspeed.com/docker/

Re:Run More Stuff in Docker by tomrod on Sunday December 27, 2020 @09:58AM (#25551444)
I do not. I'm a new user who has found resource identification difficult.
Re:Run More Stuff in Docker by fantod on Saturday December 26, 2020 @09:22PM (#25548275)
So maybe I was quick to comment, but I glanced at the images I have sitting around and python:3.7 is 876MB. However, python:3.7-slim is 112MB (still nearly twice the size of the image you describe, though). But it's conceivable that many people running into limitations with the slim image would just opt for the full Python image instead.

Maybe a better example is the Tensorflow image, which is close to 4GB for the GPU version. It's also the kind of thing that would be a pain to rebuild from scratch if you wanted to find a way to save space.

Re:Run More Stuff in Docker by peteretep on Saturday December 26, 2020 @09:25PM (#25548295)
Do you also understand that once you have any image built on top of python:3.7 then that 876MB doesn't need to be downloaded again for subsequent images?

> the Tensorflow image is really big

This is kind of meaningless without comparing it to how large Tensorflow is with related dependencies if you just install it centrally?

Re:Run More Stuff in Docker by fantod on Saturday December 26, 2020 @09:30PM (#25548322)
Yes, I understand that Docker caches layers. Like I said, if docker system prune is clearing a huge amount of space, it's like a large number of different images and containers that might not share layers. If you're build, running, starting, and stopping containers all day, you might not be terribly careful about exactly what you're doing each time. That's why system prune is so useful.
Re:Run More Stuff in Docker by systemvoltage on Saturday December 26, 2020 @08:09PM (#25547897)
That's what I am trying to ask myself too! I am sorry that I am a developer and I need to run a bunch of docker compose files.
Re:Run More Stuff in Docker by manigandham on Sunday December 27, 2020 @12:16AM (#25549050)
If you're building docker images FROM SCRATCH then there's no improvement over a zip file or statically-linked single binary (which is what packages and installers already use).

Meanwhile Docker adds many more restrictions and limitations and is not a good fit for consumer-focused interactive GUI applications which are not the web and console apps that work best with Docker.

Re:Run More Stuff in Docker by Too on Sunday December 27, 2020 @04:02AM (#25549825)
One improvement is the container is sandboxed and dependencies to the host must be added explicitly, eg --volume, --env, --net.

Sure you could do the same with chroot manually and there are many other tools that does the same thing, but somehow the docker way of representing these concepts are more graspable for average user, and much more widespread use.