Generating useful "simple"/"low-level" goals automatically indeed is an interesting avenue for pushing this further.

When this kind of software becomes mature enough that a consultant can install a robotic arm on a factory line, and quickly (several hours) train it to do the job of a factory line worker, there will be a massive economic incentive to do so.

How far do you think we are from this level of maturity? What are the remaining steps required to reach that level?

My thinking is you could train the first generation without simpler tasks but it would pick up crude skills along the way. Have the first generation generate tasks that convey the basic skills it learned and use that to teach the second generation.

Edit: Or just feedback the generated tasks and not train a new neural net...