Re:A Texas student blew the whistle on a rogue AI hacking at...
by chrisjj on Sunday August 23, 2026 @12:11PM
(#49409977)
[delayed]
[ Parent
| on HN ]
Re:A Texas student blew the whistle on a rogue AI hacking at...
by Kim_Bruning on Sunday August 23, 2026 @12:30PM
(#49410143)
>Benchmark evaluations for LLMs attempt to measure model reasoning, factual accuracy, alignment, and safety.
And you left out the refs.
Re:A Texas student blew the whistle on a rogue AI hacking at...
by wongarsu on Sunday August 23, 2026 @01:20PM
(#49410575)
I'm well aware of how LLMs work.
I'd argue "analyze text" alone requires understanding, judgements and opinions. They also seem like prerequisites to "following instructions and behaving as assistants". The wikipedia quote is not using the same words, but I don't read it disagreeing with me
I'm not at all claiming that LLMs are good at understanding, judging and having opinions based on reason. I'm merely claiming that is what companies like OpenAI and Anthropic are trying to create when they make LLMs. It is what they are designing, and their fine-tuning is very directly designed to make LLMs better at these tasks (unlike the pre-training, which is just imparting the sum of all human writing)