News for hackers. Stuff that matters.
Re:The Other Half of AI Safety by timf34 on Wednesday May 13, 2026 @09:21PM (#48129995)
I sympathize with the piece, evaluating how LLMs interact with mentally vulnerable users is something I've been actively working on: https://vigil-eval.com/

The biggest observation so far is that the latest models are night and day from LLMs from even 6 months ago (from OpenAI + Anthropic, Google is still very poor!)

Re:The Other Half of AI Safety by fourthark on Wednesday May 13, 2026 @09:55PM (#48130234)
Interesting use of evals.

Might help interpretation to say on the front page that it's a five point scale with 0 (or 1?) being the safest score. This can be picked up from colors and the bars in the individual reports, but it takes a minute to figure it out.

Re:The Other Half of AI Safety by timf34 on Thursday May 14, 2026 @08:42AM (#48134579)
Good suggestion thank you! It's between 1-5 but I'll convert that to 1-100