Llama.cpp guide – Running LLMs locally on any hardware, from scratch

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by moffkalast on Friday November 29, 2024 @07:12PM (#42278327)

Yeah the mingw method on windows is a ludicrous thing to even think about, and llama.cpp still has that as the suggested option in the readme for some weird reason. Endless sourcing of paths that never works quite right. I literally couldn't get it to work when I first tried it last year.

Meanwhile Cmake is like two lines and somehow it's the backup fallback option? I don't get it. And well on linux it's literally just one line with make.

[ Parent | on HN ]

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by blharr on Friday November 29, 2024 @09:18PM (#42278870)

Building anything on windows without cmake is just... I don't know why anyone would use anything else. I used to spend hours wrestling with build failures, but after setting up cmake, it just works with everything.

[ Parent | on HN ]

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by SteelPh0enix on Saturday November 30, 2024 @02:25AM (#42280138)

>Yeah the mingw method on windows is a ludicrous thing to even think about

Building most stuff on Windows is ludicrous, that's not something uncommon. I've chosen MSYS there as it's the easiest and least paninful way of installing deps for Vulkan build.

[ Parent | on HN ]