I'm also not impressed. He asserts blithely that "the goal is not interpretability, but accurate information", that is, only predictive ability matters. Maybe this is true in some domains, but in my experience scientists usually give a shit about what the hidden function is and are trying to learn how it behaves. No one in science wants to be left with a black box that you can't move past, they want a deeper understanding of the underlying phenomenon.