Re:What to do about GPU packages on PyPI?
by peterkelly on Thursday May 20, 2021 @07:52PM
(#27228924)
IPFS sounds like the ideal solution here. In particular because it would mean you could set up a local node to act as a cache, and pin any packages you rely on.
[ Parent
| on HN ]
I'm eagerly waiting for ipfs-based package distribution channels. They would be great both for local caches and potentially getting closer sources in countries without great mirrors.
Termux (Android app, giving a mostly-normal terminal without root) already uses IPFS.
Requiring IPFS for accessing packages/wheels exceeding a threshold from PyPI seems reasonable.
Just have PyPI offer collaborative clusters[0] for a few common situations, and maybe work with the IPFS devs to get collaborative clusters to support only pinning a subset by path (like, only pinning the packages you depend on for local CI).
IPFS would be the ideal solution to so many things if it worked well. As it stands, I don't think it would be a solution to anything, it can hardly discover content on other peers in a timeframe less than minutes...