News for hackers. Stuff that matters.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by amelius on Friday May 22, 2020 @10:19AM (#23272330)
So you are saying that if you first trained it on a different game with similar real-world mechanics, then training it on this game would require far fewer iterations?
Re:Pac-Man recreated with a GAN trained on 50k game episodes by chongli on Friday May 22, 2020 @11:05AM (#23272872)
Pac-Man isn't a purely abstract game, it's loaded with human cultural references. Pac-Man himself is a creature who loves eating food: mostly white pellets but also various kinds of fruit and of course the iconic power pellets. Fruit of course is something humans immediately identify as something good to eat and in the game they're rewarded with points which are denoted by numbers on the screen that grow larger.

It almost needn't be said that human culture puts a great deal of emphasis on making numbers grow larger, particularly those associated with personal wealth and economic growth. To a computer without this context, why should there be any reason to prefer larger numbers over smaller ones? Heck, if you're going all the way and denying the AI direct access to the game's memory, then it's got to learn to recognize the digits first before it can even begin to decide whether it's good to increase them.

Even more abstractly, the game relies on the human concepts of good and bad. It's good to eat the fruit and pellets to increase your score counter. It's bad to let a ghost catch pac-man, causing him to die and lose a life. Without being taught, human children can identify all of these elements but the computer would seem to have a more difficult task.

Re:Pac-Man recreated with a GAN trained on 50k game episodes by lonelappde on Friday May 22, 2020 @10:33AM (#23272510)
This called transfer learning and is an active area of research. It doesn't work nearly as well as it "should" if "AI" was really Artificial "Human Intelligence".
Re:Pac-Man recreated with a GAN trained on 50k game episodes by mcphage on Friday May 22, 2020 @10:25AM (#23272394)
It might. My understanding is, it is common to take trained models from one problem and use parts of them on other problems in a similar domain to speed up training.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by cyberbanjo on Friday May 22, 2020 @10:21AM (#23272353)
No, in humans the cycles involved in walking and 3d orienting carry over, so several thousand iterations of pre-game and a few of game.