News for hackers. Stuff that matters.
Re:Packaging Python software with pbr by coredog64 on Wednesday September 13, 2017 @12:13PM (#15239683)
At first glance, pbr appears to solve the problem of having to duplicate my dependencies in both setup.py and requirements.txt.
Re:Packaging Python software with pbr by daenney on Wednesday September 13, 2017 @12:18PM (#15239732)
I suppose it does doe that, so does this though:

    with codecs.open('requirements.txt') as f:
        requirements = f.read().splitlines()
    ...
    install_requires=requirements,
I don't think it's worth the dependency. But perhaps for others it is.
Re:Packaging Python software with pbr by leetrout on Wednesday September 13, 2017 @12:45PM (#15240036)
That works for simple use cases but it is not robust.

In case anyone sees this, at a minimum you need to use

  from pip.req import parse_requirements
  parse_requirements('path/to/requirements.txt')
to be safe here.
Re:Packaging Python software with pbr by bobbyi_settv on Wednesday September 13, 2017 @01:12PM (#15240334)
What if the user doesn't have pip installed? This is before we've installed the requirements, so we shouldn't be assuming anything outside the stdlib.
Re:Packaging Python software with pbr by AndrewCHM on Wednesday September 13, 2017 @02:43PM (#15241303)
if I'm not mistaken, requirements are parsed out to be installed before installing the desired package, so that should be fine
Re:Packaging Python software with pbr by blamarvt on Wednesday September 13, 2017 @02:57PM (#15241447)
Isn't that paradoxical? That code is for parsing requirements and those requirements can't be parsed until initial pre-requirements (pip, in this case) are installed.
Re:Packaging Python software with pbr by AndrewCHM on Friday September 15, 2017 @03:10PM (#15259880)
sorta

from my understanding, when you build the package, your computer extracts the relevant required packages, and sends up that data to pypi, which then in turn sends that data back to users when they install

At least thats how I think it works

Re:Packaging Python software with pbr by ak217 on Sunday September 17, 2017 @09:42PM (#15272795)
I think you may be misunderstanding the problem being discussed. The code that uses pip will crash if pip is not already installed. There is no way to parse and satisfy the dependency on pip, because the author chose to import pip as a library.
Re:Packaging Python software with pbr by AndrewCHM on Monday September 18, 2017 @11:57PM (#15281672)
pip being a dependency is defined at upload time, it is parsed by the creator of the package, not the consumer, afaik

if you used any other package manager, it would need to resolve dependencies from the additional info in the package index, resulting in pip being downloaded and installed before the desired package is installed

Re:Packaging Python software with pbr by ak217 on Sunday September 17, 2017 @09:40PM (#15272788)
This is actually less robust, since instead of relying on the setuptools API, you now also rely on the pip API.

If you control requirements.txt, there is nothing "not robust" about parsing it in setup.py.

Re:Packaging Python software with pbr by di on Wednesday September 13, 2017 @12:50PM (#15240088)
You should read this: https://caremad.io/posts/2013/07/setup-vs-requirement/, it specifically references this "feature" of pbr.
Re:Packaging Python software with pbr by joshuamorton on Wednesday September 13, 2017 @12:44PM (#15240021)
Why are you using a requirements.txt if you have a setup.py that lists them? `pip install -e` or `setup.py install` should just work in that case.
Re:Packaging Python software with pbr by cat199 on Thursday September 14, 2017 @10:19AM (#15248265)
You don't always want to install the actual package necessarily (e.g. dev) - using requirements separately lets you install the deps but not the package...
Re:Packaging Python software with pbr by rajathagasthya on Wednesday September 13, 2017 @02:34PM (#15241215)
What if you have your own package index? You can use `--index-url` in requirements.txt to specify that.
Re:Packaging Python software with pbr by joshuamorton on Wednesday September 13, 2017 @03:10PM (#15241566)
You can use `--index-url` when calling pip: https://pip.pypa.io/en/stable/reference/pip_wheel/#index-url

You can also use `dependency_links` in your setup.py to specify this, which allows deps on github etc.

Re:Packaging Python software with pbr by epage on Wednesday September 13, 2017 @04:47PM (#15242481)
The approach I've been using

Define my dependencies

- setup.py

- requirements_dev.in

run piptools pip-compile to generate a locked set of dependencies

- requirements.txt

- requirements_dev.txt

It gives me some of the benefit of Rust's Cargo.toml / Cargo.lock in the python world (and actually respects all package's dependency version declarations unlike other tools like pyup).

Re:Packaging Python software with pbr by joshuamorton on Wednesday September 13, 2017 @10:25PM (#15244568)
I'd suggest pipenv for this kind of thing. It will generate a pipfile.lock, which is the (still in development, but pretty stable) official way to create a locked set of deps.