Re:Cache is King: A guide for Docker layer caching in GitHub...
by aayushshah15 on Saturday April 06, 2024 @11:52PM
(#39958067)
how do you ensure isolation between runs on a self hosted runner that way?
[ Parent
| on HN ]
Re:Cache is King: A guide for Docker layer caching in GitHub...
by damianh on Sunday April 07, 2024 @12:02AM
(#39958108)
Selh-hosted runners can be ephemeral too. With such either mount the cache as a disk or bake docker layers/images into the runner image.
Re:Cache is King: A guide for Docker layer caching in GitHub...
by remdoWater on Sunday April 07, 2024 @12:21AM
(#39958169)
This requires a lot of work from a dev inf team, though. Not as straightforward for an average team.
Re:Cache is King: A guide for Docker layer caching in GitHub...
by ownagefool on Sunday April 07, 2024 @03:02AM
(#39958797)
It's actually pretty easy.
Setup GitHub app. Install the arc helm charts. Install a buildkitd statefulset.
Update parans on build to use buildkitd.
That's not to say there aren't better caching strategies, but a really basic ephemeral setup is right there.
Re:Cache is King: A guide for Docker layer caching in GitHub...
by damianh on Sunday April 07, 2024 @12:49AM
(#39958251)
I won't disagree. It should be easier imo. I guess this is why a cottage industry has sprung up addressing such e.g. https://news.ycombinator.com/item?id=39930908
Re:Cache is King: A guide for Docker layer caching in GitHub...
by intelVISA on Sunday April 07, 2024 @12:34PM
(#39961846)
Now I've seen everything...
Re:Cache is King: A guide for Docker layer caching in GitHub...
by boundlessdreamz on Sunday April 07, 2024 @01:00AM
(#39958284)
runs-ons supports custom images - https://runs-on.com/features/byoi/ and caching to S3 - https://runs-on.com/reference/caching/
I haven't used it yet but these two features make it the clear favourite for me in alternate github action runners
Re:Cache is King: A guide for Docker layer caching in GitHub...
by withinboredom on Sunday April 07, 2024 @12:04AM
(#39958116)
If you are in k8s, you can use the default chart provided by GitHub and get 90% of the way there.
Re:Cache is King: A guide for Docker layer caching in GitHub...
by boronine on Saturday April 06, 2024 @11:56PM
(#39958082)
What kind of isolation do you need? We are building our own code so I don't see the need for isolation beyond a clear directory.
Re:Cache is King: A guide for Docker layer caching in GitHub...
by airspeedjangle on Sunday April 07, 2024 @12:02AM
(#39958107)
Shared runner infrastructure in a big company. It's pretty common to treat these situations as multi-tenant low trust environments.
Re:Cache is King: A guide for Docker layer caching in GitHub...
by damianh on Sunday April 07, 2024 @12:54AM
(#39958270)
Plenty of marketplace actions will install things and/or mutate the runner. It's a matter of time before someone does something or there's a build that doesn't cleannup after itself (e.g. leaving test processes running) that ruins the day for everyone else.