News for hackers. Stuff that matters.
Re:The next chapter of the Microsoft–OpenAI partnership by r_lee on Tuesday October 28, 2025 @11:47AM (#45734399)
Overall I'd say the easiest is just overall that the models always just follow what you say and transform it into a response. They won't have personal opinions or experiences or anything, although they can fake it. it's all just a median expected response to whatever you say.

And the "agreeability" is not a hallucination, it's simply the path of least resistance, as in, the model can just take information that you said and use that to make a response, not to actually "think" and consider I'd what you even made sense or I'd it's weird or etc.

They almost never say "what do you mean?" to try to seek truth.

This is why I don't understand why some here claim that AGI being already here is some kind of coherent argument. I guess redefining AGI is how we'll reach it

Re:The next chapter of the Microsoft–OpenAI partnership by stevenpetryk on Tuesday October 28, 2025 @12:00PM (#45734601)
I agree with your points in general but also, when I plugged in the parent comment's nonsense question, both Claude 4.5 Sonnet and GPT-5 asked me what I meant, and pointed out that it made no sense but might be some kind of metaphor, poem, or dream.
Re:The next chapter of the Microsoft–OpenAI partnership by r_lee on Wednesday October 29, 2025 @08:55AM (#45746223)
What did you plug in?

If it wasn't structured as a coherent conversation, it will ask because it seems off, especially if you're early in the context window where I'm sure they've RLd it to push back, at least in the past year or so

And if it's going against common knowledge or etc which is prevalent in the training data, it will also push back which makes sense