Well, for some definition of fail miserably:
> Yeah, I think it wouldn't generalize super well, but I did try it on another easy level and it was able to get halfway through it.
- the author, at http://www.reddit.com/r/videos/comments/39qel5/top_super_mar...
The author has said that a net trained on one level can get about halfway through another level.
http://www.reddit.com/r/videos/comments/39qel5/top_super_mar...
Super Mario World is very deterministic.
The Author is streaming various learning tasks on his twitch. MarI/O has been trained on 3 levels so far, for 24 hours each.
If you took this neural network and tried it on another Mario level, it would fail miserably.