Re:Diffusion Models Are Evolutionary Algorithms
by jcgrillo on Wednesday November 13, 2024 @09:56PM
(#42132687)
Admittedly I haven't dug too deep into the references, including the paper the article refers to--and I'm not too well versed in diffusion models either. Those caveats aside, I'm also having trouble making the analogy, and similarly for me the hangup is about crossover. If I recall correctly, what distinguishes evolution from, say, simulated annealing at varying temperatures, is precisely the crossover operator. It's not obvious where crossover is happening here.
[ Parent
| on HN ]
Re:Diffusion Models Are Evolutionary Algorithms
by robotresearcher on Thursday November 14, 2024 @02:06AM
(#42133773)
Crossover is not a defining or essential part of an EA. Reproduction with variation under selection pressure is the definition. Crossover is one possible mechanism of reproduction with variation. Simple mutation is another.
Re:Diffusion Models Are Evolutionary Algorithms
by jcgrillo on Thursday November 14, 2024 @07:22AM
(#42135528)
Fair enough, I'm convinced now.
Re:Diffusion Models Are Evolutionary Algorithms
by wakawaka28 on Thursday November 14, 2024 @09:45AM
(#42136566)
I would not call back propagation and similar techniques "mutation". It certainly isn't random in the same sense as other random searches like EA. Maybe the exact mechanism of iteration is not that important as long as some aspect of it is random, but it's still a novel interpretation of EA.