Interpretability is just one pillar to satisfy in AI governance. You have build submodels to assist with interpreting black box main prediction models.