News for hackers. Stuff that matters.
Re:Today's Cheap AI Services Won't Last by fsiefken on Friday July 05, 2024 @06:09AM (#40881458)
Yes, the new Ryzen APU's might have 128G, great for running LLMs. https://videocardz.com/181601/amd-testing-strix-halo-apu-wit... Perhaps some other party will come up with Groq like performant LPUs and LLMs will get more precise and efficient. I read that more and more people are running their LLMs locally.

There are no comments on this comment yet.