Re:Ask HN: Which algorithms based on biological ideas do you...
by apl on Friday April 08, 2022 @10:21AM
(#30957106)
Neural architecture search (NAS) is a thing! But it's almost exclusively based on meta-gradients. Again, wouldn't put my money on GAs ever outperforming gradient-based methods again.
Re:Ask HN: Which algorithms based on biological ideas do you...
by api on Friday April 08, 2022 @01:10PM
(#30959787)
GAs follow gradients too. It's a different learning approach. All learning follows gradients in one form or another except brute force search, which is not feasible for anything larger than about 2^80 bits of state space. Evolution is not brute force.
Plenty of work on it but itβs early days and we need massive, massive, compute power.