News for hackers. Stuff that matters.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by ekianjo on Friday May 22, 2020 @10:01AM (#23272128)
> Trained on 50,000 episodes of the game

Meanwhile an actual human will probably need only about 5 games to fully understand how the game works and reacts.

Re:Pac-Man recreated with a GAN trained on 50k game episodes by pbhjpbhj on Friday May 22, 2020 @10:09AM (#23272202)
I think a few more.

Early games will establish things like "can ghosts go through each other", "if I hit the wall do I die" (like in Snake; though on Acorn Electron you could eat the wall sometimes!), "can ghosts go through the shortcut", "how long do pills last", do all pills last the same amount of time".

Then later efforts would be needed to know things like "what algorithm do the ghosts follow", "does the same colour ghost always follow the same algo", "do ghost algos change when you eat a fruit", "what order do the fruit go in" ...

Of course you could guess a lot of these, but that's not what "fully understand how the game works" means.

Re:Pac-Man recreated with a GAN trained on 50k game episodes by lonelappde on Friday May 22, 2020 @10:28AM (#23272445)
Something being glossed over is the difference between being able to play the game and being able to implement the game.

Also, Nvidia's thing doesn't do the fruits and possibly not even eating ghosts or points and probably not the ghost algos.

Re:Pac-Man recreated with a GAN trained on 50k game episodes by ttul on Friday May 22, 2020 @10:05AM (#23272158)
Fundamentally, this is because we have already been trained on years of living in and reacting to the real world, which, to some abstract degree, the game mimicks. The Nvidia model starts with nothing.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by amelius on Friday May 22, 2020 @10:19AM (#23272330)
So you are saying that if you first trained it on a different game with similar real-world mechanics, then training it on this game would require far fewer iterations?
Re:Pac-Man recreated with a GAN trained on 50k game episodes by chongli on Friday May 22, 2020 @11:05AM (#23272872)
Pac-Man isn't a purely abstract game, it's loaded with human cultural references. Pac-Man himself is a creature who loves eating food: mostly white pellets but also various kinds of fruit and of course the iconic power pellets. Fruit of course is something humans immediately identify as something good to eat and in the game they're rewarded with points which are denoted by numbers on the screen that grow larger.

It almost needn't be said that human culture puts a great deal of emphasis on making numbers grow larger, particularly those associated with personal wealth and economic growth. To a computer without this context, why should there be any reason to prefer larger numbers over smaller ones? Heck, if you're going all the way and denying the AI direct access to the game's memory, then it's got to learn to recognize the digits first before it can even begin to decide whether it's good to increase them.

Even more abstractly, the game relies on the human concepts of good and bad. It's good to eat the fruit and pellets to increase your score counter. It's bad to let a ghost catch pac-man, causing him to die and lose a life. Without being taught, human children can identify all of these elements but the computer would seem to have a more difficult task.

Re:Pac-Man recreated with a GAN trained on 50k game episodes by lonelappde on Friday May 22, 2020 @10:33AM (#23272510)
This called transfer learning and is an active area of research. It doesn't work nearly as well as it "should" if "AI" was really Artificial "Human Intelligence".
Re:Pac-Man recreated with a GAN trained on 50k game episodes by mcphage on Friday May 22, 2020 @10:25AM (#23272394)
It might. My understanding is, it is common to take trained models from one problem and use parts of them on other problems in a similar domain to speed up training.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by cyberbanjo on Friday May 22, 2020 @10:21AM (#23272353)
No, in humans the cycles involved in walking and 3d orienting carry over, so several thousand iterations of pre-game and a few of game.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by deepnotderp on Friday May 22, 2020 @01:57PM (#23274994)
This is a tired argument, experiments on humans with random textures show only a 10X slowdown, not 10,000x
Re:Pac-Man recreated with a GAN trained on 50k game episodes by ki28iukgvdru on Friday May 22, 2020 @11:56AM (#23273424)
Indeed. Some work has actually been done to try to quantify how important various types of human prior knowledge are for learning video games: https://arxiv.org/pdf/1802.10217.pdf
Re:Pac-Man recreated with a GAN trained on 50k game episodes by Ericson2314 on Friday May 22, 2020 @10:17AM (#23272298)
Humans intelligence basically evolved (as far as we know) by retarding childhood development so we had neural plasticity longer to learn more. Crazy that we're giving our already-dumb AIs the extra challenge of learning things from nothing and doing so quickly.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by __s on Friday May 22, 2020 @10:05AM (#23272160)
I wouldn't say "fully" https://www.gamasutra.com/view/feature/3938/the_pacman_dossi...

& also that humans come with a huge amount of training beforehand. We've experienced eating & ghost stories & moving around in 3d spatial dimensions before playing pacman usually

Re:Pac-Man recreated with a GAN trained on 50k game episodes by lonelappde on Friday May 22, 2020 @10:41AM (#23272600)
OTOH if you told a current AI a ghost story it wouldn't be able to do anything useful with that info a pacman context.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by ekianjo on Saturday May 23, 2020 @09:46AM (#23282898)
Not a very convincing argument. Even when Pac man was new and video games barely existed it took no time to get how it works.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by Ididntdothis on Friday May 22, 2020 @11:16AM (#23273007)
Because it resembles a world you are very familiar with. Let’s say you have something we don’t have experience with, for example docking two satellites with orbital mechanics, the humans would be struggling because their intuition is wrong. AI may do better with this.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by c1b on Friday May 22, 2020 @05:34PM (#23277317)
and how many games does a human need to transform into a pacman game playable by another human? ...lol
Re:Pac-Man recreated with a GAN trained on 50k game episodes by ekianjo on Saturday May 23, 2020 @09:48AM (#23282911)
The same. Once you understand how it works its just about coding. Coding Tetris never required anyone to play millions of times either.