News for hackers. Stuff that matters.
Re:Apple has new Mac app coming to make running local AI mod... by iantpe on Wednesday November 11, 2026 @08:39AM (#50453287)
What I need most right now is a model like TypeSafe's Jev that can be built directly into the computer.

Jev allows for numerous small judgments: Is this email important? Which program should handle this request? Is this operation risky? There's no need for large LLMs to slowly generate long paragraphs of text; all you need is a fast, structured result that returns the message.

Having a local Jev-like model in the operating system for quick decision-making, and then calling the larger model when deeper thinking is needed, would be very useful.

Re:Apple has new Mac app coming to make running local AI mod... by madebywelch on Wednesday November 11, 2026 @08:42AM (#50453317)
I'm using Ollama https://ollama.com/library/kev for this now.
Re:Apple has new Mac app coming to make running local AI mod... by satvikpendem on Wednesday November 11, 2026 @01:46PM (#50456948)
Not recommended to use Ollama, I like Unsloth.

https://sleepingrobots.com/dreams/stop-using-ollama/

Re:Apple has new Mac app coming to make running local AI mod... by 233mhz on Wednesday November 11, 2026 @10:23AM (#50454510)
> There's no need for large LLMs

Do you know how big jev is? Decision models are small but the "smart" (aka useable) ones aren't that small.

Re:Apple has new Mac app coming to make running local AI mod... by hhh on Wednesday November 11, 2026 @12:15PM (#50455851)
I think ~30b params
Re:Apple has new Mac app coming to make running local AI mod... by illwrks on Wednesday November 11, 2026 @10:23AM (#50454511)
In a way you want something like blackberry messenger, a centralised hub for all app messages, notices etc, and then JEV hooked into it as a traffic controller of sorts. I wonder if there’s anything like that, perhaps on Linux?
Re:Apple has new Mac app coming to make running local AI mod... by CharlieDigital on Wednesday November 11, 2026 @11:34AM (#50455346)
They are even small enough to run in browsers: https://openjev.com/
Re:Apple has new Mac app coming to make running local AI mod... by boogieknite on Wednesday November 11, 2026 @12:04PM (#50455706)
https://github.com/TheoLeeCJ/SemIf-OpenJev

dabbling with it in browsers but i expect it would answer the mail for you, if you find it accurate enough