A good eBook on the subject that the author continually updates- Interpretable Machine Learning, A Guide for Making Black Box Models Explainable.

This book helped me implement Accumulated Local Effects in Python which we used to explain a timeseries model.

[0] https://christophm.github.io/interpretable-ml-book/