Re:Jeff Dean Responds to EDA Industry about AlphaChip
by cma on Sunday December 01, 2024 @07:49AM
(#42288196)
Training from scratch could presumably mean including the new design attempts and old designs mixed in.
So no contradiction: pretrain on old designs then finetune on new design, vs train on everything mixed together throughout. Finetuning can cause catastrophic forgetting. Both could have better performance than not including old designs.
So no contradiction: pretrain on old designs then finetune on new design, vs train on everything mixed together throughout. Finetuning can cause catastrophic forgetting. Both could have better performance than not including old designs.