Re:We deploy 5X faster with warm Docker containers
by lewo on Wednesday March 08, 2023 @04:28AM
(#35066950)
> would be hard to beat "sync a file to a warm container and run it"
It depends on the size of your Pex file (i don't think you mentioned it and sorry if i missed the info). With a Docker/OCI image, it would be possible to create a layer with only the Python files of your application (without deps and interpreter). (I say "would be possible" because that's currently not easy to achieve with Nix for instance.)
Re:We deploy 5X faster with warm Docker containers
by robertlagrant on Wednesday March 08, 2023 @04:36AM
(#35067003)
> I believe all cached Docker layers will need to be downloaded onto the build machine before it can be rebuilt
Docker making some sort of layer-sharing mechanism that constantly distributes layers to all build runners would be worth some cash, I reckon.
Irrespective of the CI, I believe all cached Docker layers will need to be downloaded onto the build machine before it can be rebuilt.
Still, I believe it is possible to build and deploy faster even with a "docker image only" design and it's something we are still looking at. The question is what is the lower bound here - would be hard to beat "sync a file to a warm container and run it". Pex gives us a pretty good lower bound that is also container platform agnostic.