Re:Llama.cpp 30B runs with only 6GB of RAM now
by pdntspa on Saturday April 01, 2023 @11:11AM
(#35400892)
With the margins that tech makes, many companies could certainly afford to care more about code quality. But they don't, instead it gets stuffed into cash reserves where the money sits idle, doing nothing but enriching shareholders.
Or hiring useless business people to install around the periphery of engineering. Which is funny because now tech is letting all those folks go.
Or hiring useless business people to install around the periphery of engineering. Which is funny because now tech is letting all those folks go.