News for hackers. Stuff that matters.
Re:DALL·E: Creating Images from Text by ve55 on Tuesday January 05, 2021 @05:16PM (#25651943)
Yes, but there's no reason we can't partially solve this by throwing more data at the models, since we have vast amounts of data we can use for that (ratings, reviews, comments, etc), and we can always generate more en masse whenever we need it.
Re:DALL·E: Creating Images from Text by minimaxir on Tuesday January 05, 2021 @05:26PM (#25652054)
This isn't a problem that can be solved with more data. It's a function of model architecture, and as OpenAI has demonstrated, larger models generally perform better even if normal people can't run them on consumer hardware.

But there is still a lot of room for more clever architectures to get around that limitation. (e.g. Shortformer)

Re:DALL·E: Creating Images from Text by ve55 on Tuesday January 05, 2021 @05:44PM (#25652257)
I think it's both - we have a lot of architectural improvements that we can try now and in the future, but I don't see why you can't take the output of generative art models, have humans rate them, and then use those ratings to improve the model such that its future art is likely to get a higher rating.