News for hackers. Stuff that matters.

A comment on Llama.cpp: Full CUDA GPU Acceleration. Parent comment

Re:Llama.cpp: Full CUDA GPU Acceleration by tekknik on Wednesday June 14, 2023 @08:23AM (#36324788)
The hidden magic is adjusting env vars used by python, LD, etc. Adjusting paths only seems like magic until you understand what it’s doing.

I’ve done with with plenty of languages including C/C++

[ Parent | on HN ]
Re:Llama.cpp: Full CUDA GPU Acceleration by throwawaymaths on Wednesday June 14, 2023 @11:06AM (#36327097)
Yes I know how it works but try explaining that to someone learning flask at a boot camp.
[ Parent | on HN ]
Re:Llama.cpp: Full CUDA GPU Acceleration by tekknik on Saturday June 17, 2023 @09:30PM (#36376475)
I mean I wouldn’t expect someone at a boot camp to understand this nor was this a topic of conversation, so /shrug?
[ Parent | on HN ]