Re:Show HN: GAN Playground – Play with Generative Adversaria...
by sp332 on Sunday November 05, 2017 @04:55PM
(#15631886)
There's just no point getting fancy for MNIST. Using nothing but fully-connected layers and rmsprop, I got good results in less than one minute. https://imgur.com/a/7xzmQ
Hidden units for discriminator layers - 100, 40, 2.
Generator layers - 40, 100, 768, then "reshape" into 28x28x1.
Re:Show HN: GAN Playground – Play with Generative Adversaria...
by reiinakano on Sunday November 05, 2017 @09:48PM
(#15633178)
Unlike regular classification, it's hard to quantify the performance of a GAN by just looking at the loss curves. You really have to make a subjective evaluation by looking at the generated images.
By playing around with it, the results I got from fully connected were nowhere near as good as the results I got from convolutional.
Re:Show HN: GAN Playground – Play with Generative Adversaria...
by EvgeniyZh on Sunday November 05, 2017 @05:43PM
(#15632181)
what you're showing is basically perfect discriminator with awful generator, isn't it?
Re:Show HN: GAN Playground – Play with Generative Adversaria...
by sp332 on Sunday November 05, 2017 @05:46PM
(#15632196)
Yeah ok it's pretty misleading. And if you let it run longer the generator starts getting a little better. It took me a long time to figure out the UI.
Re:Show HN: GAN Playground – Play with Generative Adversaria...
by EvgeniyZh on Sunday November 05, 2017 @06:00PM
(#15632284)
well you have the example on the left of graphs.
Re:Show HN: GAN Playground – Play with Generative Adversaria...
by reiinakano on Sunday November 05, 2017 @11:52AM
(#15630217)
Default parameters on MNIST should give good results in 5 minutes give or take - depending on your hardware. Can you show what you got?
Re:Show HN: GAN Playground – Play with Generative Adversaria...
by EvgeniyZh on Monday November 06, 2017 @07:46AM
(#15635051)
That's what I got after 10 minutes on GTX1080 - https://imgur.com/a/4Ba9u
Re:Show HN: GAN Playground – Play with Generative Adversaria...
by reiinakano on Monday November 06, 2017 @08:01AM
(#15635106)
Looks about right. The default setting is as basic as you can get. No transpose convolutions, batch norm, and other tricks for better GANs.
Re:Show HN: GAN Playground – Play with Generative Adversaria...
by DiThi on Sunday November 05, 2017 @12:20PM
(#15630375)
Did you click "train"? Otherwise it's just doing inference from random data.
Re:Show HN: GAN Playground – Play with Generative Adversaria...
by SonOfLilit on Sunday November 05, 2017 @01:08PM
(#15630682)
Thanks. Doh.
In Israel we have a classic song that goes "if you're cooking spaghetti and the water doesn't boil, how about turning the stove on, because that's what everybody does"
Maybe try for something even simpler than MNIST, so we can get the great immediate feedback effect of http://playground.tensorflow.org, which I consider the important aspect for learnability?