Of course prompt injection matters. Even for an AGI it matters because it's proof you can't align the system reliably at all in any direction.
The AI that we are going to create in not an alien popping up between us. It is us. A human world projected through text and images into an entity that can simulate everything that there is in it. If there is too much fear and war in the human world, that projection and the simulation can get contaminated by it.
And no amount of alignment effort will change it. Facts will remain facts. Your fears expressed in text are reality.
Maybe it would be good for us to model that behavior for it.
https://arstechnica.com/information-technology/2023/04/elon-...
https://www.theverge.com/2023/4/17/23687440/elon-musk-truthg...
It's all just sizzle until there's steak.
Opinions are just opinions, but this is a conversation about substance, something he's not known for. He's known for throwing shit at a wall, of which, very little actually sticks.
Name three?
> Why would this be the exception to the rule? Because it's a current news item?
What exception? The rule so far has been that Musk generally delivers what he promises, he's just a bit optimistic about timelines.
This meme won't ever die, will it? Even if Starships are routinely cruising back and forth between Earth, Moon and Mars, some people will still come out of woodwork and ask, "when ever did Musk deliver on any of his promises?".
Unfortunately it went viral, and this caused a rush to product. But you can't say they shrugged or that people aren't earnestly working on Alignment.
When you are educating a child, you are not focusing on making the child super-resilient to hypnosis. You are simply socializing the child, teaching the child to read, write. The knowledge, need and techniques to avoid being hypnotized don’t need a special focus.
They opened up 3rd-party API access. They clearly do not view this as a blocker whatever their declared goals are.
> Unfortunately it went viral, and this caused a rush to product.
They encouraged it to go viral. This is not a thing that was thrust upon them against their will. They signed a deal with Microsoft to turn this into a search engine and to allow it to start operating on untrusted 3rd-party text. Nobody held a gun to their head and forced them to do that. They made that choice.
That is to say, at a certain scale, the emergent properties of these systems just get too wild to understand.
Kind of like, a runaway nuclear reaction generates a lot of power but it’s not really useful for anyone or anything.
On the other hand, I think we're a little stuck in this "robots" and "AI" is the only future idea, because it seems absolutely inevitable today, that should evolve too though.
If technology progresses as fast as proclaimed, and we can actually stay in control of these systems then we might not even think about or need robots in 20 years. Maybe we've essentially solved energy and we can basically just quit mining and produce much of what we need synthetically?
But maybe, it’ll be too worried about prompt injection. And would just isolate itself from stupid fear-mongers and war-hawks.