Re:Pypi.org is running a survey on the state of Python packa...
by greymalik on Wednesday September 07, 2022 @08:32PM
(#32759387)
What packages are you referring to? I’ve been doing professional Python dev on a Mac for the past three years and have never had a reason to use conda, so I’m curious what I’m missing.
[ Parent
| on HN ]
Re:Pypi.org is running a survey on the state of Python packa...
by pletnes on Thursday September 08, 2022 @12:33AM
(#32761208)
It’s only the last 5 years, give or take, that you can install C-compiled packages with pip. When I started out, I had to apt/port/pacman install packages, then run pip install (or python setup.py even) to install dependencies. It’s hard for newer python converts to even comprehend the pain it used to be. Conda came with the compiled package concept, and pip came after. Dealing with dependencies these days is a breeze, relatively speaking. On windows you even needed a visual studio license, just to pip install numpy!
Re:Pypi.org is running a survey on the state of Python packa...
by BerislavLopac on Thursday September 08, 2022 @03:30AM
(#32762441)
> It’s only the last 5 years, give or take, that you can install C-compiled packages with pip
Give, quite a bit. The egg format was introduced in 2004 [0], and even the newer wheel, that replaced it, is turning 10 later this month.
[0] https://packaging.python.org/en/latest/discussions/wheel-vs-...
Re:Pypi.org is running a survey on the state of Python packa...
by dagw on Thursday September 08, 2022 @09:39AM
(#32765358)
Just because the egg/wheel format existed, didn't mean that they where actually used and actually worked. Being able to reliable pip install packages like numpy and gdal only started 3-4 years ago. There is a reason that Christoph Gohlke's python package site exists and was popular.
Re:Pypi.org is running a survey on the state of Python packa...
by pletnes on Thursday September 08, 2022 @09:34AM
(#32765278)
I started using numpy around 2007 and didn’t see reliable binary installs with good numerical performance until I discovered anaconda, much later (2016?). Maybe I hung out with the wrong people, or libraries. Some libraries did not have compiled wheels a few years ago, and M1 macs still run into the very occasional issue.
Re:Pypi.org is running a survey on the state of Python packa...
by pletnes on Thursday September 08, 2022 @09:37AM
(#32765313)
9 out of the top 360 packages still do not offer wheels!
https://pythonwheels.com/
Re:Pypi.org is running a survey on the state of Python packa...
by BerislavLopac on Friday September 09, 2022 @04:30AM
(#32776799)
Not having a wheel is not really an issue for Python-only packages.
Re:Pypi.org is running a survey on the state of Python packa...
by pletnes on Monday September 12, 2022 @02:14PM
(#32814474)
You’re running install-time code if you don’t, so I disagree. The wheel format is better suited even for pure python distribution. You can read more details on that site.
Re:Pypi.org is running a survey on the state of Python packa...
by deepsquirrelnet on Wednesday September 07, 2022 @10:32PM
(#32760389)
Conda environments are the most isolated from the host os, outside of using docker or a vm. They’re also the most heavyweight. As a package manager, you can install a lot of non-python stuff. It’s more similar to apt or yum than pip. You can even do things like run bash on windows with m2, which I usually find preferable to wsl.
Re:Pypi.org is running a survey on the state of Python packa...
by aeyes on Wednesday September 07, 2022 @10:33PM
(#32760395)
pyarrow for example, if you don't have a wheel then good luck building one without using conda. It's not impossible but the developers don't really support it.
Official dependency and build tooling is not properly geared for C extensions. You'll be looking at compiler errors to figure out what dependencies you are missing.
Re:Pypi.org is running a survey on the state of Python packa...
by pletnes on Thursday September 08, 2022 @02:26AM
(#32761912)
Conda ships Intel MKL for linear algebra, too, meaning numpy.dot (matrix multiply), scipy, fft, solvers, … run 2-10x faster. Well, used to, I think the open source alternatives have improved since.