Llama.cpp: Full CUDA GPU Acceleration

Re:Llama.cpp: Full CUDA GPU Acceleration by realusername on Tuesday June 13, 2023 @02:51AM (#36306502)

I personally really don't like much Python, I find it as tedious to write as Go but without the added performance, typesafety and autocomplete benefits that comes with it in exchange.

If I have use a dynamic language, at least make it battery included like Ruby. Sure it's also not performant but I get something back in exchange.

Python sits in a very uncomfortable spot which I don't find a use for. Too verbose for a dynamic language and not performant enough compared to a more static language.

The testing culture is also pretty poor in my opinion, packages rarely have proper tests, (and especially in the ML field)

[ Parent | on HN ]

Re:Llama.cpp: Full CUDA GPU Acceleration by emmender on Tuesday June 13, 2023 @10:26AM (#36310679)

In addition to the above:

1) function decorators etc have made the code unreadable

2) while code is succinct, a lot of abstraction is hidden in some C/C++ language binding somewhere, so, when there is a problem, it is hard to debug

3) Pytorch has become a monolithic monster with practically no-one understanding its functionality e-2-e

[ Parent | on HN ]