Protecting Exploration in an Efficient System
I'm currently thinking about ways to protect exploration inside systems.Like making sure an exploration budget stays.Do people have good solutions for that?
https://claude.ai/public/artifacts/d12af7c5-3eb0-4218-a505-e...
I'm currently thinking about ways to protect exploration inside systems.Like making sure an exploration budget stays.Do people have good solutions for that?
Currently there doesn't seem to be anyone trying to simulate the tradeoffs between a singleton and a multipolar setup. Or looking at other tradeoffs like hidden and known agents, homogenous vs diverse agents and others.With LLMs it seems like we have a sandbox to test some of these things.Is this wrong?
Hi,I'm working on a document to map the risks from AI and the mitigations on the human side of thing.For example it seems likely that we will have more AI persuasion [1] in the future. So I'm mapping what we can do to mitigate this.Give me a shout if you are interested.[1]...
I've been thinking a lot about humans potentially losing important skills due to using AI and I was wondering how we can get better at getting and maintaining skills.Can wee gamify learning important skills for the future? Study harder what improves studying skills (using AI if needed). And get that knowledge out to more people.Humanity needs to be at the top of its game to deal with AI in a...
I've been thinking about recursive self improvement. But especially the likelihood that it will be important soon. Soon means with current LLMs that might just give up or delete the test set or otherwise detach from reality. Call the probability of that happening P. You can estimate P by looking at research tasks and how much they need to get helped along by humans to stay on task.Goedel...
And HN isn't it...
I'm looking for pieces that explore the problem of attempting to regulate an industry (say AI) when the incumbents (say Google and Microsoft) control email and search.
It seems that we focus a lot on making systems that we can correct or are right from the start.Has there been much focus on creating systems that have a built in expiration date, so they have to be rebuilt regularly with the increased understanding.
This would allow niches to exist, without people being able to post off-topic things to your feed.
A forest is not one tree. It is many different things growing in the same place, competing, cooperating, dying, regrowing. No single species runs it. It holds together because the diversity itself is the structure.Human civilisations tend toward monocultures. One way of thinking crowds out the others - not because anyone chooses it, but because successful ideas spread. This has always happened....
[1] https://simonwillison.net/2025/Jun/16/the-lethal-trifecta/
But general purpose compute no
I've been working on wasm sandboxing and automatic verification that code doesn't have the lethal trifecta and got something working in a couple of days.
I'd like to do a clean rewrite at some point.
This seems like a very hard problem with coding specifically as you want unsafe content (web searches) to be able to impact sensitive things (code).
I'd love to find people to talk to about this stuff.
Use AI to scaffold relationships not replace them.
That is hard too though.
It would require it not to be easy to farm (Entropy detection on user behaviour perhaps and clique detection).
If done in an auditably unlogged environment (with a limited output to the company, just saying escalate) it might also encourage people to share vulns they are worried about putting online.
Does that make sense from your experience?
[1] https://github.com/eb4890/echoresponse/blob/main/design.md
I'm building something to help people figure out if a company knows an unknown security vulnerability in a product, without leaking the exact vulnerability to the company. It is not a magic bullet, but should save time on both parties sides.Would love to have a chat with people about it.