News for hackers. Stuff that matters.
Re:Go, Python, Rust, and production AI applications by Art9681 on Tuesday March 12, 2024 @09:50AM (#39679494)
Can you elaborate on this or point me to some more information? I am primarily a Go dev that has been integrating AI/ML into a personal project. Like many other apps, I wrap llama.cpp and various other popular ML projects.

Recently I have been getting the itch to go lower level and see if it would be feasible to write an LLM backend in pure Go, or a Stable Diffusion backend. Just for curiosity and learning.

But if this is a dead-end I would like to know from someone more experienced than I. Thanks for any advice you can offer in advance.

Re:Go, Python, Rust, and production AI applications by nerdix on Tuesday March 12, 2024 @11:02AM (#39680362)
Do you know of any resources with details on using llama.cpp with Go?