News for hackers. Stuff that matters.
Re:Cache is King: A guide for Docker layer caching in GitHub... by aayushshah15 on Saturday April 06, 2024 @11:52PM (#39958067)
how do you ensure isolation between runs on a self hosted runner that way?
Re:Cache is King: A guide for Docker layer caching in GitHub... by damianh on Sunday April 07, 2024 @12:02AM (#39958108)
Selh-hosted runners can be ephemeral too. With such either mount the cache as a disk or bake docker layers/images into the runner image.
Re:Cache is King: A guide for Docker layer caching in GitHub... by remdoWater on Sunday April 07, 2024 @12:21AM (#39958169)
This requires a lot of work from a dev inf team, though. Not as straightforward for an average team.
Re:Cache is King: A guide for Docker layer caching in GitHub... by ownagefool on Sunday April 07, 2024 @03:02AM (#39958797)
It's actually pretty easy.

Setup GitHub app. Install the arc helm charts. Install a buildkitd statefulset.

Update parans on build to use buildkitd.

That's not to say there aren't better caching strategies, but a really basic ephemeral setup is right there.

Re:Cache is King: A guide for Docker layer caching in GitHub... by damianh on Sunday April 07, 2024 @12:49AM (#39958251)
I won't disagree. It should be easier imo. I guess this is why a cottage industry has sprung up addressing such e.g. https://news.ycombinator.com/item?id=39930908
Re:Cache is King: A guide for Docker layer caching in GitHub... by intelVISA on Sunday April 07, 2024 @12:34PM (#39961846)
Now I've seen everything...
Re:Cache is King: A guide for Docker layer caching in GitHub... by boundlessdreamz on Sunday April 07, 2024 @01:00AM (#39958284)
runs-ons supports custom images - https://runs-on.com/features/byoi/ and caching to S3 - https://runs-on.com/reference/caching/

I haven't used it yet but these two features make it the clear favourite for me in alternate github action runners

Re:Cache is King: A guide for Docker layer caching in GitHub... by withinboredom on Sunday April 07, 2024 @12:04AM (#39958116)
If you are in k8s, you can use the default chart provided by GitHub and get 90% of the way there.
Re:Cache is King: A guide for Docker layer caching in GitHub... by boronine on Saturday April 06, 2024 @11:56PM (#39958082)
What kind of isolation do you need? We are building our own code so I don't see the need for isolation beyond a clear directory.
Re:Cache is King: A guide for Docker layer caching in GitHub... by airspeedjangle on Sunday April 07, 2024 @12:02AM (#39958107)
Shared runner infrastructure in a big company. It's pretty common to treat these situations as multi-tenant low trust environments.
Re:Cache is King: A guide for Docker layer caching in GitHub... by damianh on Sunday April 07, 2024 @12:54AM (#39958270)
Plenty of marketplace actions will install things and/or mutate the runner. It's a matter of time before someone does something or there's a build that doesn't cleannup after itself (e.g. leaving test processes running) that ruins the day for everyone else.