News for hackers. Stuff that matters.
Re:OpenAI releases image generation in the API by thegeomaster on Thursday April 24, 2025 @05:53PM (#43787926)
Well, there's also gemini-2.0-flash-exp-image-generation. Also autoregressive/transfusion based.
Re:OpenAI releases image generation in the API by yousif_123123 on Thursday April 24, 2025 @07:14PM (#43788560)
It's also good but clearly not close still. Maybe Gemini 2.5 or 3 will have better image gen.
Re:OpenAI releases image generation in the API by thefourthchime on Thursday April 24, 2025 @06:08PM (#43788038)
Such a good name....
Re:OpenAI releases image generation in the API by Yiling-J on Thursday April 24, 2025 @09:44PM (#43789389)
gemini-2.0-flash-exp-image-generation doesn’t perform as well as GPT-4o's image generation, as mentioned in section 5.1 of this paper: https://arxiv.org/pdf/2504.02782. However based on my test, for certain types of images such as realistic recipe images, the results are quite good. You can see some examples here: https://github.com/Yiling-J/tablepilot/tree/main/examples/10...
Re:OpenAI releases image generation in the API by swyx on Thursday April 24, 2025 @11:23PM (#43789820)
> transfusion based.

what is that?

Re:OpenAI releases image generation in the API by thegeomaster on Friday April 25, 2025 @04:56PM (#43798427)
It's a mix between the Transformer architecture and diffusion, shown to provide better output results than simple autoregressive image token generation alone: https://arxiv.org/html/2408.11039v1

Of course, nobody really knows what 4o image generation really is under the hood, but it looks to be like some kind of hybrid system like Transfusion to me. It is much better at prompt adherence than diffusion models, but its output can be clunkier/stylistically incoherent. At times, it also exhibits similar failure modes as diffusion (such as weirdly rotated body parts).

Given how it behaves, I think Gemini 2.0 Flash image generation is probably the same approach but with a smaller parameter count. It's... eerie... how close together these two were released and how similar they appear to be.

Re:OpenAI releases image generation in the API by raincole on Friday April 25, 2025 @12:43AM (#43790163)
It's quite bad now, but I have no doubt that Google will catch up.

The AI field looks awfully like {OpenAI, Google, The Irrelevent}.