News for hackers. Stuff that matters.
Re:Apple has new Mac app coming to make running local AI mod... by monegator on Wednesday November 11, 2026 @01:50AM (#50450403)
yes. People do not read.

I agree with you, and i would like to set up a server at work for local inference but we simply do not have the knowledge, it's much easier to get a couple of AI Max machines that are good enough for me and the boss which i convinced on the good points on running clankers locally and be done with it (though my plan is to use the AI MAX machines to figure out what the infrastructure and workflow will look like, and at some point ask for the investment)

Re:Apple has new Mac app coming to make running local AI mod... by rick1290 on Wednesday November 11, 2026 @02:02AM (#50450481)
this is neat. how has it been going with the ai max machines? also looking to do the same as id like to get ahead.
Re:Apple has new Mac app coming to make running local AI mod... by monegator on Wednesday November 11, 2026 @03:49AM (#50451090)
I don't know yet! The boxes have been sitting there for a while. It's been a crazy month
Re:Apple has new Mac app coming to make running local AI mod... by monegator on Saturday November 14, 2026 @10:59AM (#50498053)
ok, a colleague started playing with the AI MAX 395, qwen 3.8 flash next unsloth running at 40tk/s

damn, too bad that the laptops with the 470 are capped at 64GB

Re:Apple has new Mac app coming to make running local AI mod... by throwuxiytayq on Wednesday November 11, 2026 @02:30AM (#50450674)
> but we simply do not have the knowledge

How is this literally even possible in 2026? In a thread about LLMs, no less?

Re:Apple has new Mac app coming to make running local AI mod... by monegator on Wednesday November 11, 2026 @03:47AM (#50451073)
assimilating knowledge still take time, i do not take whatever LLMs regurgitate at face value.

Then there's testing the approaches and see whatever sticks best.

Re:Apple has new Mac app coming to make running local AI mod... by dansquizsoft on Wednesday November 11, 2026 @06:32AM (#50452178)
Yeah this is a wild take…