News for hackers. Stuff that matters.

A comment on Building a personal, private AI computer on a budget. Parent comment

Re:Building a personal, private AI computer on a budget by CamperBob2 on Tuesday February 11, 2025 @10:14AM (#43013729)
The 1.58-bit DeepSeek R1 dynamic quant model from Unsloth is no joke. It just needs a lot of RAM and some patience.
[ Parent | on HN ]
Re:Building a personal, private AI computer on a budget by jaggs on Tuesday February 11, 2025 @05:52PM (#43019417)
There seems to be a LOT of work going on to optimize the 1.58-bit option in terms of hardware and add-ons. I get the feeling that someone from Unsloth is going to have a genuine breakthrough shortly, and the rig/compute costs are going to plummet. Hope I'm not being naïve or over-confident.
[ Parent | on HN ]