Re:EchoLeak – 0-Click AI Vulnerability Enabling Data Exfiltr...
by simonw on Thursday June 12, 2025 @01:19AM
(#44254508)
That's awesome to hear! I was never sure if anyone had managed to get it working.
[ Parent
| on HN ]
Re:EchoLeak – 0-Click AI Vulnerability Enabling Data Exfiltr...
by soulofmischief on Thursday June 12, 2025 @03:09AM
(#44254927)
Not quite the same, but OpenAI is doing it in the opposite direction with their thinking models, hiding the reasoning step from the user and only providing a summarization. Maybe in the future, hosted agents have an airlock in both directions.
> ... in the future we may wish to monitor the chain of thought for signs of manipulating the user. However, for this to work the model must have freedom to express its thoughts in unaltered form, so we cannot train any policy compliance or user preferences onto the chain of thought. We also do not want to make an unaligned chain of thought directly visible to users.
> Therefore, after weighing multiple factors including user experience, competitive advantage, and the option to pursue the chain of thought monitoring, we have decided not to show the raw chains of thought to users.
Source: https://openai.com/index/learning-to-reason-with-llms/
Re:EchoLeak – 0-Click AI Vulnerability Enabling Data Exfiltr...
by tough on Thursday June 12, 2025 @09:24PM
(#44264886)
Google Deepmind published a paper based on this too https://arxiv.org/abs/2503.18813