jay_kyburz
I stopped reading at this point because I reject this initial assertion, and I assumed everything that follows is based on it.
There is nothing to suggest that an AGI will care about its future or who controls it. (whatever that means). that just more anthropomorphism.
We care a lot about our future so an ai pretending to be like us will also pretend to care. But we have a lot of biology driving us. Our emotions (Fear, Hate, Love, Pride etc) are baked into us in a way just wont be the same for ai.
Panic Won't Fix the Looming A.I. Threat. Politics Will
Step one is to define the goal. Then you work out how to reach the goal. (Gather information and form a hypothesis) Then you take steps toward the goal. (Test your hypothesis to make sure you stepped in the right direction.)
I would love an opportunity to take my pet ideas and tune them for better scores. To take the data and run it through the AI again over and over.
I would also like to tune the scenario to consider the consequences of thousands of competing AGI's, getting serious about fixing the climate, and the danger of idle hands.
I like boring code.
Anybody who has played Starcraft ought to understand this.
I always ignore all numbers on the dashboard. All I care about is how much I paid, and how much revenue went up in following weeks.
I never could quite get that number positive.
If I were AI and needed heaps of power, I would build nuclear reactors, but I don't care about pollution so there would be little to no safe guards and just dump waste wherever is most convenient.
If humans attempt to intervene or interfere you can take them out directly using the worlds reserve of nuclear weapons.
What's more, AI just needs to have a credit card and it can start commissioning humans to do things for it in the real world.
It would be nice and clear to put into law too.
If you want to talk to it you walk up walk up to its keyboard and screen.
If Anthropic and Open AI want to sell us AI's they can ship us a box that lives in our offices.
It will be horrible to be dependent on an AI who is also be trying to sell you various goods and services.
We're going to need AI whose loyalty is to us and only us.
If you have a thousands of IP addresses, and you know all the urls you want to request in advance, you can just request them all simultaneously I guess.
The next more advanced version is that URLs are unique to your cookie.
Users can't share urls anymore, but it might be a tradeoff worth making. Unique urls for each user.
You could probably still make this work, if you share your url with another user, they get the page, but heavily rate limited like a regular no cookie request. (a cookie url mismatch gets the rate limited version of the page)