News for hackers. Stuff that matters.
Re:U.S. Science Is in Chaos by LoganDark on Wednesday June 17, 2026 @06:46PM (#48578063)
> claude, gemini and chatgpt are very good at communicating

There is no communication there. No concepts for them to communicate. It is just math.

Re:U.S. Science Is in Chaos by nfw2 on Wednesday June 17, 2026 @07:34PM (#48578519)
Regardless of the implementation, claude causes concepts to enter my brain, so it is at least one-way communication. Human brains have mundane implementations as well: chemical signals firing across neural synapses. No magic special sauce, at least not that we can detect
Re:U.S. Science Is in Chaos by LoganDark on Wednesday June 17, 2026 @07:53PM (#48578673)
I would say you communicate to the model and you interpret the model's outputs. I would not say the model communicates back though.

I'm not sure that models are complex enough to have a consistent internal representation of a concept the same way that organic brains can to communicate. I'm not sure of any quantitative science backing this up though. Models don't know anything across iterations yet.

Re:U.S. Science Is in Chaos by blackoil on Wednesday June 17, 2026 @09:50PM (#48579571)
> Models don't know anything across iterations yet.

Can you expand. They have both context and memory?

Re:U.S. Science Is in Chaos by LoganDark on Wednesday June 17, 2026 @09:56PM (#48579630)
Most models do not have any persistent state or output that is separate from their input. They consume a stream of tokens and then output a probability distribution. The probability distribution will always be the exact same for that particular stream of tokens. There is no internal state, thoughts, mood etc., only prediction based on the input. "Memory" is usually just something injected into context by the harness and updated by usually a tool call from the model.

I'm sure there are research prototypes that work differently from this but I haven't seen any enter the mainstream yet.

Also, diffusion language models have a different evaluation order but I think they also do not really have internal thoughts or feelings because they also do not seem to have any sort of hidden state that encodes anything like that.

Re:U.S. Science Is in Chaos by bavell on Wednesday June 17, 2026 @08:59PM (#48579185)
My rock collection causes concepts to enter my brain, but I don't think I'd say they're communicating with me, nor I with them.