News for hackers. Stuff that matters.
Re:What to do about GPU packages on PyPI? by peterkelly on Thursday May 20, 2021 @07:52PM (#27228924)
IPFS sounds like the ideal solution here. In particular because it would mean you could set up a local node to act as a cache, and pin any packages you rely on.
Re:What to do about GPU packages on PyPI? by viraptor on Thursday May 20, 2021 @08:32PM (#27229185)
I'm eagerly waiting for ipfs-based package distribution channels. They would be great both for local caches and potentially getting closer sources in countries without great mirrors.
Re:What to do about GPU packages on PyPI? by namibj on Thursday May 20, 2021 @08:35PM (#27229198)
Termux (Android app, giving a mostly-normal terminal without root) already uses IPFS.

Requiring IPFS for accessing packages/wheels exceeding a threshold from PyPI seems reasonable.

Just have PyPI offer collaborative clusters[0] for a few common situations, and maybe work with the IPFS devs to get collaborative clusters to support only pinning a subset by path (like, only pinning the packages you depend on for local CI).

[0]: https://cluster.ipfs.io/documentation/collaborative/

Re:What to do about GPU packages on PyPI? by StavrosK on Friday May 21, 2021 @06:38AM (#27232380)
IPFS would be the ideal solution to so many things if it worked well. As it stands, I don't think it would be a solution to anything, it can hardly discover content on other peers in a timeframe less than minutes...