Re:Apple has new Mac app coming to make running local AI mod...
by madebywelch on Wednesday November 11, 2026 @08:42AM
(#50453317)
I'm using Ollama https://ollama.com/library/kev for this now.
Re:Apple has new Mac app coming to make running local AI mod...
by satvikpendem on Wednesday November 11, 2026 @01:46PM
(#50456948)
Not recommended to use Ollama, I like Unsloth.
Re:Apple has new Mac app coming to make running local AI mod...
by 233mhz on Wednesday November 11, 2026 @10:23AM
(#50454510)
> There's no need for large LLMs
Do you know how big jev is? Decision models are small but the "smart" (aka useable) ones aren't that small.
Re:Apple has new Mac app coming to make running local AI mod...
by hhh on Wednesday November 11, 2026 @12:15PM
(#50455851)
I think ~30b params
Re:Apple has new Mac app coming to make running local AI mod...
by illwrks on Wednesday November 11, 2026 @10:23AM
(#50454511)
In a way you want something like blackberry messenger, a centralised hub for all app messages, notices etc, and then JEV hooked into it as a traffic controller of sorts.
I wonder if there’s anything like that, perhaps on Linux?
Re:Apple has new Mac app coming to make running local AI mod...
by CharlieDigital on Wednesday November 11, 2026 @11:34AM
(#50455346)
They are even small enough to run in browsers: https://openjev.com/
Re:Apple has new Mac app coming to make running local AI mod...
by boogieknite on Wednesday November 11, 2026 @12:04PM
(#50455706)
https://github.com/TheoLeeCJ/SemIf-OpenJev
dabbling with it in browsers but i expect it would answer the mail for you, if you find it accurate enough
Jev allows for numerous small judgments: Is this email important? Which program should handle this request? Is this operation risky? There's no need for large LLMs to slowly generate long paragraphs of text; all you need is a fast, structured result that returns the message.
Having a local Jev-like model in the operating system for quick decision-making, and then calling the larger model when deeper thinking is needed, would be very useful.