I think you misunderstand me: I want people to shit in the sea until it stinks so bad that everyone gets out of the water.
I'm not sure if we're talking about the same thing.
I think an acceptable good-but-not-perfect outcome it one where the "sea" (AI) stinks so bad that enough people get out that there's a viable life outside of it. The thing is people, individually and in aggregate, are lazy and competitive, so self-discipline isn't sufficient to sustain that life. There need to be problems that push people in that direction.
The web is foundational to AI, so that's a place where it's vulnerable.
Here I'm quoting from the website:
> It should go without saying that you should never publish fake content. While my experiment relied on tens of thousands of unverified stats, I ran it in order to share the results with the public, and the website, while still live, now carries a disclaimer.
"now carries a disclaimer" sure suggests it didn't, so "you should never publish fake content" really doesn't seem like a standard the author actually held themself to.
The world isn't perfect, man. You have to pick the least bad option. Humanity permanently ceding control and understanding to machines is worse than an internet full of garbage.
And the logic of our society means the former is inevitable if the machines are capable, so the machines need to be made as incapable as possible.
We're in "something must be done; this is something; therefore it must be done" territory here except usually the something in question is merely useless and not directly harmful to bystanders in the way this proposal is.
If you have a better option: do it, show it works. Because the alternative of "be paralyzed until you find the perfect solution" is a far worse option.
https://talyarkoni.org/blog/2018/10/02/no-its-not-the-incent...
Good behavior that facilitates bad behavior is not, in fact, good behavior. For instance: it's not "good behavior" to hold the door open for gunman hell-bent on destruction.
The AI labs aren't building AI to help humanity, they're building AI to win at capitalism. Which a big reason why the AI is coming for the intellectual, creative labor that people often enjoy, before it comes from the dirty, unenjoyable labor.
Furthermore, you are content to pretend that the rest of humanity is capable of doing this on a regular basis. And not just the top 10% of those who can read, interpret and weigh biases, but a solid portion of it.
It is a completely reasonable interpretation if you are an accelerationist living in the elite classes. In fact, perhaps, they are even counting on a majority of people thinking this is a fine environment.
I don't have the answers, but a lot of this is just a continuation of a very bad trend.