News for hackers. Stuff that matters.
Re:A brief history of LLaMA models by jiggawatts on Sunday April 30, 2023 @03:41AM (#35760414)
> specialize in ML research not software engineering.

That has nothing to do with Python tooling being bad. A safe assumption is that Python package managers are being developed by developers, who have no excuse.

If a C++ codebase developed by scientists had null pointer exceptions in it, then I could excuse things. But if the C++ compiler itself introduced unforced null pointer errors, then it absolutely deserves criticism.

It shouldn't be possible for a ML researcher to use Conda or whatever package manager in a way that despite using a formally specified "requirements.txt", it won't build a week later because of how loose the specification of module versions is allowed to be.

The Python attitude and more specifically Conda is at fault here, not the ML researching trying to get his job done.

Re:A brief history of LLaMA models by qaq on Sunday April 30, 2023 @09:04AM (#35762166)
Poetry is fairly reasonable package manager
Re:A brief history of LLaMA models by alchemist1e9 on Sunday April 30, 2023 @09:10AM (#35762222)
One point you have I absolutely agree with:

> Conda is at fault here

Conda is so so bad. But trying to explain why to people who have fallen into it’s trap is difficult. People don’t realize the packages are not signed on enough information to reproduce them. The optimizer to find matching versions to make an environment that satisfies your constraints is really bad idea.

As an experienced C++ developer unfortunately and fortunately I’ve concluded the most “correct” solution is to use nixpkgs.

Re:A brief history of LLaMA models by dventimi on Sunday April 30, 2023 @11:47AM (#35763680)
What's a good alternative? No, really. Conda has caused me so much pain.
Re:A brief history of LLaMA models by alchemist1e9 on Sunday April 30, 2023 @07:28PM (#35767506)
As I mentioned I’ve settled on Nix with nixpkgs however it’s got a steep learning curve and really isn’t appropriate for anyone but fairly experienced unix hackers.

It’s a problem.