I also find the related ideas of neuroevolution of the weights of a neural networks to be fascinating in its own right.

I've implemented "cooperative coevolution" which felt like magic when I considered how good it is (on some tasks like continuous control RL problems) relative to known good methods like anything involving gradients.

I wish that this stuff was explored a bit more. Seems we are leaving the paradigm of evolutionary methods...