News for hackers. Stuff that matters.
Re:Ask HN: What would you preserve if the internet were to g... by tarruda on Sunday November 03, 2024 @04:30PM (#42036237)
> Download as many LLM models and the latest version of Ollama.app and all its dependencies.

I recently purchased a Mac Studio with 128gb RAM for the sole purpose of being able to run 70b models at 8-bit quantization

Re:Ask HN: What would you preserve if the internet were to g... by 867-5309 on Sunday November 03, 2024 @07:30PM (#42037339)
well done, good for you!
Re:Ask HN: What would you preserve if the internet were to g... by FloatArtifact on Monday November 04, 2024 @08:51AM (#42041505)
M4?
Re:Ask HN: What would you preserve if the internet were to g... by mikestew on Monday November 04, 2024 @01:21PM (#42044493)
Mac Studios don't have the M4 yet. With that much RAM, GP must have the M2 Ultra.