I often wonder if Midjourney, behind the scenes, has already discovered something like this in their v5 release, which is substantially better at modelling things like hands.
It masquerades as summarizing the paper, but it's a random grab of whatever OP decided to jam into the chatbox that fits in the context window, (if you check, its mostly regurgitating the abstract).
However, it presents itself as a summary as if the entire paper was read.
I'm _really_ into AI stuff but the flippant nature its used at on HN has me scared. People here are generally well-educated, considered in their decisions, and are well acquainted with tech. If HN can't avoid glaring issues with it, who can?
The top example that came to mind was someone laboriously sharing a really nice data-driven comment, someone asks source? they say ChatGPT, and acted like we were trolling for saying it hallucinates.
It missed a _ton_ for me, it seems to pick out unique phrases and elegantly create a "skeleton" of the original.
> I did not use GPT-4 to summarize the whole paper.
> I don't think GPT-4 missed anything crucial from the blog.
?
Diffusion models are generative models that work by perturbing data using a stochastic process, then reversing this process to generate new data. However, when discretized into discrete steps (as in most practical implementations), the sampling process can negatively affect data quality. To alleviate this issue, a technique called thresholding is employed, resulting in better samples but breaking the theoretical framework.
Reflected Diffusion Models use a reflected stochastic differential equation (rSDE) to correctly model the thresholding process. This allows the models to train appropriately while respecting boundary constraints, like images with pixel values in the [0, 255] range.
The benefits of Reflected Diffusion Models include improved perceptual quality, correct handling of boundary constraints, better image generation with guidance, and general applicability to different shapes of data domains. This has the potential to expand the applications of diffusion models in fields such as image, language, and molecule generation.