Re:Andrej Karpathy talks about how Tesla's NNs are structure...
by mattrp on Sunday November 10, 2019 @02:02PM
(#21499527)
This is correct - read the fantastic “making of the atomic bomb” - the planners kept competition alive for as long as possible because no one really knew which path was going to work. In contrast the nazi project, among other reasons, failed because it focused nearly exclusively on heavy water and didn’t have internally competing projects.
Which is a sign they were pretty worried about choosing to put all their smart guys on one path, and picking the wrong one. And the number of smart guys they had was certainly a real constraint. Even under their very stressed circumstances, exploration and competition were important.