Yes, and they don't usually look too much alike (see the BigGAN appendix nearest-neighbors for example of doing this) but some people argue this isn't a good enough check because the GAN could just be shuffling around patches of textures or something, which is a little goal-post-move-y for my taste.