News for hackers. Stuff that matters.
Re:Experimenting with Local LLMs on macOS by oblio on Tuesday September 09, 2025 @01:44AM (#45177852)
Can you run any of those models without $20 000 worth of hardware that uses as much power and makes as much noise as a small factory?
Re:Experimenting with Local LLMs on macOS by segmondy on Wednesday September 10, 2025 @03:22PM (#45202402)
I run them with under $3,000 hardware and inference is about 500-600watts with no noise.