Solving Sudoku in Python Packaging

Re:Solving Sudoku in Python Packaging by zahlman on Wednesday October 23, 2024 @02:43AM (#41922459)

People keep trying to sell the speed of such solutions as a killer feature for uv, but I think I must not be anywhere near the target audience. The constraint-solving required for the sorts of projects I would typically work on is not even remotely as complex, while I'm bottlenecked by a slow, unreliable Internet connection (and the lack of a good way to tell Pip not to check PyPI for new versions and only consider what's currently in the wheel cache).

[ Parent | on HN ]

Re:Solving Sudoku in Python Packaging by kvdveer on Wednesday October 23, 2024 @03:58AM (#41922842)

Our CI took 2 minutes to install the requirements. Adding UV dropped that to seconds. Now most time is spent on running tests, instead of installing requirements.

Of course we could've cached the venv, but cache invalidation is hard, and this is a very cheap way to avoid it.

[ Parent | on HN ]

Re:Solving Sudoku in Python Packaging by zahlman on Wednesday October 23, 2024 @05:54AM (#41923480)

Or you could cache the solve, surely? Simply explicitly including your transitive dependencies and pinning everything should do the trick - but there is work being done actively on a lockfile standard, it's just the sort of topic that attracts ungodly amounts of bikeshedding.

(One of these days I'll have to figure out this "CI" thing. But my main focus is really just solving interesting programming problems, and making simple elegant tools for mostly-small tasks.)

[ Parent | on HN ]

Re:Solving Sudoku in Python Packaging by itsbjoern on Wednesday October 23, 2024 @03:35AM (#41922721)

Personally I’m just a fan of people improving dev tooling, regardless of it ultimately making a huge difference to my workflow. I haven’t used uv yet, but I’m still tangentially following it because despite pip and poetry being great tools I have had my fair share of grievances with them.

[ Parent | on HN ]

Re:Solving Sudoku in Python Packaging by yunohn on Wednesday October 23, 2024 @10:38AM (#41925489)

Using uv (IME) should be a drop-in replacement for almost all of your python packaging needs. I highly recommend giving it a shot - it’s saved me measurable time in just a few months.

[ Parent | on HN ]

Re:Solving Sudoku in Python Packaging by the_mitsuhiko on Wednesday October 23, 2024 @07:19AM (#41923831)

> while I'm bottlenecked by a slow, unreliable Internet connection (and the lack of a good way to tell Pip not to check PyPI for new versions and only consider what's currently in the wheel cache).

Which is one of the reasons why uv is so fast. It reduces the total times it needs to go to PyPI! Not only does it cache really well, it also hits PyPI more efficiently and highly parallel. Once you resolved once, future resolutions will likely bypass PyPI for the most part entirely.

[ Parent | on HN ]

Re:Solving Sudoku in Python Packaging by zahlman on Wednesday October 23, 2024 @07:57AM (#41924061)

Oh, that's good to hear. The performance discourse around uv seems to revolve around "written in Rust! Statically compiled!" all the time, but an algorithmic change like that is something that could conceivably make its way back into Pip. (Or perhaps into future competing tools still written in Python. I happen to have a design of my own.)

[ Parent | on HN ]

Re:Solving Sudoku in Python Packaging by simonw on Wednesday October 23, 2024 @02:41PM (#41928038)

More significant than the speed improvement in my opinion is the space saving.

The reason uv is fast is that it creates hard links from each of your virtual environments to a single shared cached copy of the dependencies (using copy-on-write in case you want to edit them).

This means that if you have 100 projects on your machine that all use PyTorch you still only have one copy of PyTorch!

[ Parent | on HN ]

Re:Solving Sudoku in Python Packaging by zahlman on Wednesday October 23, 2024 @04:59PM (#41929229)

This is definitely a feature I wanted to have in my own attempt (hopefully I can start work on it before the end of the year; I think I'll bump up my mental priority for blogging about the design). I also have considered symlink (not sure if this really works) and .pth file-based approaches.

(TIL `os.link` has been supported on Windows since 3.2.)

[ Parent | on HN ]