News for hackers. Stuff that matters.
Re:Jeff – Jev-compatible 0.8B decision models, trained at ho... by ad1ttya on Tuesday September 29, 2026 @02:02AM (#49888833)
i guess it's not needing to finetune for each specific use case
Re:Jeff – Jev-compatible 0.8B decision models, trained at ho... by dcl on Tuesday September 29, 2026 @02:13AM (#49888914)
That is indeed reasonable. But you still need a bunch of trusted data to validate the accuracy of Jev.
Re:Jeff – Jev-compatible 0.8B decision models, trained at ho... by prodigycorp on Tuesday September 29, 2026 @02:18AM (#49888951)
Yes. The difference is you can immediately benchmark and iterate via prompting without having to retrain. It's such a time saver.
Re:Jeff – Jev-compatible 0.8B decision models, trained at ho... by dcl on Tuesday September 29, 2026 @02:24AM (#49889003)
Is it though? I have found it much easier to fit/diagnose/improve simple classifiers on embeddings/hash vectorized features/etc than iterate on prompts, especially true when using the more modern LLM's (like gpt 5.6 Luna) where you can't even set the temperature to get any sense of determinism.

I do note though, that is infinitely easier to 'deploy' a Jev/LLM based solution than a data/model pipeline.

Re:Jeff – Jev-compatible 0.8B decision models, trained at ho... by prodigycorp on Tuesday September 29, 2026 @03:00AM (#49889242)
The comparison i'm making is against a training of encoder/small decoder model so I think we agree on most things. I dont think jev replaces the benefit of embeddings nor think they are mutually exclusive. All part of a handy utility belt.
Re:Jeff – Jev-compatible 0.8B decision models, trained at ho... by jmpeax on Tuesday September 29, 2026 @02:43AM (#49889120)
Then the probabilities are not calibrated. Jev is basically the LLM version of the "is-even" library.