One of the best sessions I had was a fairly epic story about a god of shadows whose unruly shadow monsters were attacking all humans. The god himself wanted them stopped and sought my (a powerful mage) help. We needed to make our way to his lair where a powerful ritual could destroy him and banish all his minions.
After an epic tale the plan succeeds, the god is destroyed, his shadows disperse. As the dust settles the god congratulates me but reminds me that I must make haste for the god of shadows has sent his monsters to attack all humans and he must be stopped...
To provide an example, it's almost like you need a _time series_ of GPT-3s, not just a single GPT-3 neural network, and the model itself would need to be able to self-inspect those time series and say to itself "ah yes, this was my old foolish understanding, now I have this new, better, understanding". I have no idea how this would look in technical terms, these are just the musings of a somewhat more-than-casual AI observer.
As mentioned there are buttons for redoing or changing the AI response. This is because it often spouts nonsense or loses the plot.
In my example above the god who should have been dead talked about himself as a third person.
The AI also often mixes up people's gender or roles. One issue that used to be very common but has improved lately is that it used to mix up who said what in dialogues.
Yes, this kind of problem is real. But recent papers show you can ask the model to do reasoning / chain of thought / rationales before coming up to the answer. They can do complex tasks in a series of small steps instead of trying to do it in one step and failing. I believe it's not a fundamental limitation, just a matter of "blurting out something stupid" vs "taking your time to think before you speak".
One of the foremost core requirements for actual general intelligence.
Do you have any specific papers in mind?
It could...
> the real solution will be some sort of hybrid
An engine that built ontologies even just through ANNs could maybe suffice. It's still a game of entities and relations ("state" is still a relation, and relations can be implemented in ANNs).
Meaning that the network has to define "battler", "instance", "Link", "Kirby", "engulf", "fireball", "victory", "death", and progressively "know" what those things are and what they imply. It has to build a world including the laws and the entities.
https://ai.googleblog.com/2022/04/pathways-language-model-pa...
GPT-3 anecdotally can't pick up on chain-of-thought quite as well. https://www.lesswrong.com/posts/EHbJ69JDs4suovpLw/testing-pa...
For a cartoonish video game, that's not too far fetched...
I've seen more ridiculous things in animes and such.
That said, I do get your point, and I agree.
> ... the real solution will be some sort of hybrid between a neural net and some sort of finite state automata.
From https://datascience.stackexchange.com/a/25819:
> There is research showing that a DNN can simulate any FSM. Since there are more frameworks for DNN and DNN can perform more tasks than FSM, it appears to be more useful just to forgo FSM altogether.
> More specifically, "Neural network for synthesizing deterministic finite automata" shows how a relatively simple neural network (NN) can quickly and automatically learn the correct deterministic finite automaton (DFA).
Why not go one step further and have build in game engines that will work like imaginations of future states based from interactions within and between engines.
For example, a popular Youtube video has a battle between Link and Kirby in it: "He finally releases the Hylian Shield and lets Link be engulfed in a massive fireball. When Link is reduced to a pile of ashes, Kirby is victorious. Kirby wins the fight to the death. Link stands there, dazed by the attack."
Most of that actually sounds pretty darn good and even sounds written by a human. It's to the point where there is a sensible structure to the story because the AI is getting the relationships between words. Massive fireball -> pile of ashes -> victory -> wins the fight to the death. That all looks good. The problem is that "Link is reduced to a pile of ashes" should put Link into a "dead" state, and when in the "dead" state Link can't stand and be dazed.
The problem of course is that the computer can't understand all of this. It can understand that there is a probabilistic link between "pile of ashes" and "fight to the death" so after writing the first it is much more likely to write the second. But it still doesn't understand what "death" actually means. I've thought for a while that neural nets alone aren't going to solve machine generated speech and that the real solution will be some sort of hybrid between a neural net and some sort of finite state automata. The finite state automata could then put a character into a "dead" state and know that when in a "dead" state they can't "stand" or "be dazed."
Source: (Video by DougDoug where he manually sets up battles between characters with a few paragraphs and then lets the AI generate the text of the battle. Sometimes it makes sense and other times someone's face will turn into a button or their eyes will shoot lasers) https://www.youtube.com/watch?v=PwY-jVSM-f0&t=2835s