News for hackers. Stuff that matters.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by ttul on Friday May 22, 2020 @10:05AM (#23272158)
Fundamentally, this is because we have already been trained on years of living in and reacting to the real world, which, to some abstract degree, the game mimicks. The Nvidia model starts with nothing.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by amelius on Friday May 22, 2020 @10:19AM (#23272330)
So you are saying that if you first trained it on a different game with similar real-world mechanics, then training it on this game would require far fewer iterations?
Re:Pac-Man recreated with a GAN trained on 50k game episodes by chongli on Friday May 22, 2020 @11:05AM (#23272872)
Pac-Man isn't a purely abstract game, it's loaded with human cultural references. Pac-Man himself is a creature who loves eating food: mostly white pellets but also various kinds of fruit and of course the iconic power pellets. Fruit of course is something humans immediately identify as something good to eat and in the game they're rewarded with points which are denoted by numbers on the screen that grow larger.

It almost needn't be said that human culture puts a great deal of emphasis on making numbers grow larger, particularly those associated with personal wealth and economic growth. To a computer without this context, why should there be any reason to prefer larger numbers over smaller ones? Heck, if you're going all the way and denying the AI direct access to the game's memory, then it's got to learn to recognize the digits first before it can even begin to decide whether it's good to increase them.

Even more abstractly, the game relies on the human concepts of good and bad. It's good to eat the fruit and pellets to increase your score counter. It's bad to let a ghost catch pac-man, causing him to die and lose a life. Without being taught, human children can identify all of these elements but the computer would seem to have a more difficult task.

Re:Pac-Man recreated with a GAN trained on 50k game episodes by lonelappde on Friday May 22, 2020 @10:33AM (#23272510)
This called transfer learning and is an active area of research. It doesn't work nearly as well as it "should" if "AI" was really Artificial "Human Intelligence".
Re:Pac-Man recreated with a GAN trained on 50k game episodes by mcphage on Friday May 22, 2020 @10:25AM (#23272394)
It might. My understanding is, it is common to take trained models from one problem and use parts of them on other problems in a similar domain to speed up training.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by cyberbanjo on Friday May 22, 2020 @10:21AM (#23272353)
No, in humans the cycles involved in walking and 3d orienting carry over, so several thousand iterations of pre-game and a few of game.
Re:Pac-Man recreated with a GAN trained on 50k game episodes by deepnotderp on Friday May 22, 2020 @01:57PM (#23274994)
This is a tired argument, experiments on humans with random textures show only a 10X slowdown, not 10,000x
Re:Pac-Man recreated with a GAN trained on 50k game episodes by ki28iukgvdru on Friday May 22, 2020 @11:56AM (#23273424)
Indeed. Some work has actually been done to try to quantify how important various types of human prior knowledge are for learning video games: https://arxiv.org/pdf/1802.10217.pdf
Re:Pac-Man recreated with a GAN trained on 50k game episodes by Ericson2314 on Friday May 22, 2020 @10:17AM (#23272298)
Humans intelligence basically evolved (as far as we know) by retarding childhood development so we had neural plasticity longer to learn more. Crazy that we're giving our already-dumb AIs the extra challenge of learning things from nothing and doing so quickly.