News for hackers. Stuff that matters.
Re:Llama.cpp: Full CUDA GPU Acceleration by nologic01 on Tuesday June 13, 2023 @03:48AM (#36306959)
I think what has happened is that because Python is sweet and easy to use for many things, it generated irrational expectations that is perfect for all things. But its just an interpreted language that started as a scripting and gluing oriented language.

Its deployment story is where this gap frequently shows. Desktop apps at best passable, whereas e.g. android apps practically non-existing despite the efforts of projects like kivy.

Re:Llama.cpp: Full CUDA GPU Acceleration by simion314 on Tuesday June 13, 2023 @09:11AM (#36309759)
The problem seems to be getting a project that works on the developer machine packaged and distributed to non developers. Some type of projects seem harder to distribute, this ML dependencies seem to change fast and everything breaks(maybe because the dependencies are not locked correctly).