Re:Alphafold
by Tenoke on Thursday July 15, 2021 @11:28PM
(#27852780)
>No it's not. Only Google spends significant time with automatic architecture search, and many people think this is really to try to sell cloud capacity.
Maybe not automatic architecture search but a lot does go into testing different architectures and changes to them in a more manual manner. Though yes, those tests are run on a smaller scale so for those huge models, training will be a bigger portion compared to architecture search than for smaller models.
Maybe not automatic architecture search but a lot does go into testing different architectures and changes to them in a more manual manner. Though yes, those tests are run on a smaller scale so for those huge models, training will be a bigger portion compared to architecture search than for smaller models.