Run a 1T parameter model on a 32gb Mac by streaming tensors from NVMe

Re:Run a 1T parameter model on a 32gb Mac by streaming tenso... by root_axis on Tuesday March 24, 2026 @01:50PM (#47506530)

Are there any 1T parameter open source models?

[ Parent | on HN ]

Re:Run a 1T parameter model on a 32gb Mac by streaming tenso... by zozbot234 on Tuesday March 24, 2026 @01:52PM (#47506562)

Kimi 2.5?

[ Parent | on HN ]

Re:Run a 1T parameter model on a 32gb Mac by streaming tenso... by ai-inquisitor on Tuesday March 24, 2026 @02:22PM (#47506959)

That model is "open weight", not open source. We have no idea what data Moonshot trained on.

[ Parent | on HN ]

Re:Run a 1T parameter model on a 32gb Mac by streaming tenso... by airspresso on Wednesday March 25, 2026 @04:22AM (#47514686)

I think we lost that terminology war. Open source models mean open weight. There are only a couple examples of fully open source models with open data and code, and the labs are not incentivized to go that far.

[ Parent | on HN ]

Re:Run a 1T parameter model on a 32gb Mac by streaming tenso... by root_axis on Tuesday March 24, 2026 @02:00PM (#47506661)

Thanks, TIL.

[ Parent | on HN ]