News for hackers. Stuff that matters.
Re:This Artwork Does Not Exist by gridlockd on Thursday March 05, 2020 @01:17AM (#22491364)
It's exponentially more expensive to train these at higher resolutions.
Re:This Artwork Does Not Exist by gwern on Thursday March 05, 2020 @10:58AM (#22494655)
Not exponentially. More like linearly in pixel count, you just tack on another convolution block. (StyleGAN doesn't use self-attention, but even naive self-attention is just quadratic.)

The problem is more that you hit diminishing returns fast from training at higher resolutions. There's not too much difference between training at 1024px or training at 512px and using an off-the-shelf superresolution NN upscaler, but the latter is like 4x faster. So why bother? You don't always even have input data which is 1024px+.