1 backprop is not necessarily the only thing able to perform optim.. it could be something more parallel that try many path at once. a bit like quantum computing.. but we have not just found the algo yet

2 is basically sleeping.