Re:Llama.cpp: Full CUDA GPU Acceleration
by sp332 on Monday June 12, 2023 @11:14PM
(#36304705)
I have to agree. Installing dependencies for some git repos is a total crapshoot. I ended up wasting so much hard drive space with copies of pytorch. Meanwhile llama.cpp is just "make" and takes less time to build than to download one copy of pytorch.
[ Parent
| on HN ]
So, the solution is that everyone should write code as self-contained C++ code and not use any software libraries ever. Dependency hell has been solved for all time!
Well, in the cases where the libraries are causing more work than they are solving. Then yes.
There is a happy medium... somewhere. After following Postgres development for the better part of a decade, I think it's definitely closer to the python side of things... But man they (python) do make it hard to like using that ecosystem.
The flip side is like you said... You will just have to reimplement everything yourself and then you can never worry about dependencies again! Just hope you didn't introduce some obscure security issue in your hashmap implementation .
Python was released in 1991. It obviously didn’t get package management right, just like C and C++ didn’t figure it out in the 70s.
Take a look at rust’s Cargo for what a modern package manager should look like. Or deno / Go if you swing that way.
Which old language gets package management right? None of them. None of them get it right.
And sure - conda / venv / CMake / etc help. But last century’s bad design decisions still shine through.