felipepsuch
Re:Generative Teaching Networks: Accelerating Neural Architecture Search
on Thursday February 20, 2020 @02:15PM (#22377710)
Thanks, I'm glad you liked it!
Mode collapse was actually the one thing I never encountered during my exploration (which was the reason we looked into using GTNs as a mode-collapse solution for GANs). That said, I found meta-learning to be surprisingly hard to implement efficiently and ran into more bugs in both PyTorch and TensorFlow than I can count.
Changing the learner architecture is not that important actually so that's probably not your problem.
Re:Generative Teaching Networks: Accelerating Neural Architecture Search
on Thursday February 20, 2020 @01:16PM (#22377189)
The generator we use in our paper is a form of restriction of 'direct' training data. You can think of it as a weird encoding for images.
PS: I'm the author of the GTN paper. Feel free to ask any questions