We also think there should be more Ablation Studies in deep learning research. To make it easier, we are working on automating the process of disabling components of models with a framework called Maggy. Pass in your Keras Model and specify which layes/components to mask out and we will generate all models and train them in parallel. https://databricks.com/session_eu20/parallel-ablation-studie... https://github.com/logicalclocks/maggy