Re:Kraken – P2P Docker Registry
by toyg on Tuesday November 03, 2020 @08:22AM
(#24979376)
This is so cool.
Will I ever use it? Probably not, I’m a hobbyist at the moment. Do I think everything should be P2P, particularly if infrastructure-critical like a registry? Hell yes.
Re:Kraken – P2P Docker Registry
by majewsky on Tuesday November 03, 2020 @08:37AM
(#24979508)
Most organizations are not Google or Facebook or Uber, so setting up a P2P network of registries is ghoulish overkill. Any image registry with a HA setup (e.g. API pods in Kubernetes and backing storage in Ceph or a NetApp cluster or whatever) is probably enough.
Source: I've implemented a federating image registry for use at $dayjob (https://github.com/sapcc/keppel). Before doing so, I evaluated the landscape and also looked at Kraken briefly.
Re:Kraken – P2P Docker Registry
by LockAndLol on Tuesday November 03, 2020 @06:17PM
(#24985138)
Since you have experience writing your own registry, do you think it would be difficult to support IPFS (or a similar distributed storage technology) for pulling images? I'm thinking HTTP for metadata and IPFS for storage could reduce the load on registries significantly, but I know very little about registries.
Re:Kraken – P2P Docker Registry
by majewsky on Saturday November 07, 2020 @06:43PM
(#25021003)
Conceptually, no big deal. Most registries already deliver blob contents from a CDN or object store (via HTTP redirect). However, the registry protocol (i.e. the Open Containers Distribution API) only knows HTTP, so you'd have to use a HTTP-to-IPFS proxy to use the IPFS backing store with existing clients.
Re:Kraken – P2P Docker Registry
by makeworld on Tuesday November 03, 2020 @10:18AM
(#24980370)
> Kraken's goal is to reduce global max download time and communication overhead in a stable environment, while BitTorrent was designed for an unpredictable and adversarial environment, so it needs to preserve more copies of scarce data and defend against malicious or bad behaving peers.
Looks like it can't just be deployed on the Internet for us to use as an alternative, it's mostly for trusted internal use. Too bad.
Re:Kraken – P2P Docker Registry
by tiew9Vii on Tuesday November 03, 2020 @06:33PM
(#24985227)
When I saw Dockerhub announce they are throttling pulls I did think using something like IPFS (InterPlanetary File System)[1] would be ideal for a public Docker image repository.
Dockerhub must be a huge expense for the free repositories, switching to P2P would significantly reduce the running costs.
https://lovecraft.fandom.com/wiki/Cthylla
Will I ever use it? Probably not, I’m a hobbyist at the moment. Do I think everything should be P2P, particularly if infrastructure-critical like a registry? Hell yes.
Source: I've implemented a federating image registry for use at $dayjob (https://github.com/sapcc/keppel). Before doing so, I evaluated the landscape and also looked at Kraken briefly.
Looks like it can't just be deployed on the Internet for us to use as an alternative, it's mostly for trusted internal use. Too bad.
Dockerhub must be a huge expense for the free repositories, switching to P2P would significantly reduce the running costs.
[1] https://ipfs.io/