Re:Llama.cpp 30B runs with only 6GB of RAM now
by sp332 on Friday March 31, 2023 @07:18PM
(#35395087)
In March 2014, Tunney petitioned the US government on We the People to hold a referendum asking for support to retire all government employees with full pensions, transfer administrative authority to the technology industry, and appoint the executive chairman of Google Eric Schmidt as CEO of America
Re:Llama.cpp 30B runs with only 6GB of RAM now
by hackernewds on Friday March 31, 2023 @09:44PM
(#35396194)
what's your point? also interestingly JART is in the thread here, so they might have read your comment :)
Ah I see https://news.ycombinator.com/user?id=jart