Re:Jeeves. Reasoning improves Jev-like decision models
by janalsncm on Tuesday September 29, 2026 @02:54PM
(#49898542)
I can’t see your gist but spam classification is a textbook example of something you shouldn’t measure with accuracy. If 95% of your samples are not spam you can get 95% accuracy by always guessing not spam.
You should use precision (when your model says “spam” how often is it spam?), recall (how many of the spam emails did it catch), or f1 (balanced between those two).
Re:Jeeves. Reasoning improves Jev-like decision models
by nico on Tuesday September 29, 2026 @03:03PM
(#49898693)
That's a great point. My case is not for spam, the classes are more balanced, but you are correct that precision, recall and f1 would be better measures for some of these tasks
You should use precision (when your model says “spam” how often is it spam?), recall (how many of the spam emails did it catch), or f1 (balanced between those two).