News for hackers. Stuff that matters.
Re:What to do about GPU packages on PyPI? by StavrosK on Friday May 21, 2021 @06:37AM (#27232369)
There should really exist a transparent pip proxy, then I can set the config of all my CI machines to it and `pip install foo` would do the right thing and install from that cache. I just want a single binary that I can run with zero configuration and have it talk to PyPI and cache packages locally. It would save so much bandwidth.
Re:What to do about GPU packages on PyPI? by rcxdude on Friday May 21, 2021 @07:33AM (#27232729)
This is one of the key things which artifactory can do (and it can do it for basically any repository type, not just pypi). It's not so straightforward to set up, however.
Re:What to do about GPU packages on PyPI? by hksh on Friday May 21, 2021 @03:09PM (#27238541)
I have yet to discover a more-than-default-repository setup that is straightforward when using artifactory.
Re:What to do about GPU packages on PyPI? by ArchOversight on Monday May 24, 2021 @02:32PM (#27268006)
You are in luck, such a tool exists:

https://www.devpi.net

In the past I've run this in a docker container, setup some pip environment variables and its off to the races. It transparently caches stuff from PyPi and keeps things local.

Re:What to do about GPU packages on PyPI? by Epic_Wink on Saturday May 22, 2021 @08:39AM (#27245930)
Most CI vendors offer caching directories between builds, and then you set the pip cache directory. Failing that, I made a proxy server that can work transparently if you can set default environment variables: check out proxpi
Re:What to do about GPU packages on PyPI? by StavrosK on Saturday May 22, 2021 @08:48AM (#27245988)
proxpi is exactly what I was looking for, thank you! The straightforward Docker installation is especially great, I can have it running with one command.
Re:What to do about GPU packages on PyPI? by Macha on Friday May 21, 2021 @08:49AM (#27233345)
Such things certainly exist, we had one in my previous employer though I don't remember if it was something in-house, an artifactory feature, or something open source.
Re:What to do about GPU packages on PyPI? by StavrosK on Friday May 21, 2021 @08:52AM (#27233383)
Hmm, if you were using Artifactory, it sounds like that's what was doing that. I'm not aware of a dead simple, plug-and-play thing, though.