News for hackers. Stuff that matters.

A comment on Llama.cpp 30B runs with only 6GB of RAM now. Parent comment

Re:Llama.cpp 30B runs with only 6GB of RAM now by rvz on Friday March 31, 2023 @08:47PM (#35395797)
Exactly.

It also shows the number of impostors in this thread and inflated titles of self-proclaimed 'seniors' who can't optimize ML code to even be on the same league as Tunney (jart), and Gerganov (ggerganov).

Not even ChatGPT or Copilot could even submit a change or in-fact completely rewrite and optimize this code like they have done.

[ Parent | on HN ]
Re:Llama.cpp 30B runs with only 6GB of RAM now by visarga on Saturday April 01, 2023 @12:14AM (#35397055)
Remember this moment when you're about to criticise LLMs. People can act suboptimal too, even experts.
[ Parent | on HN ]