That was it, although I see I've conflated the views of Gary Marcus (who I think it is fair to characterize as anti-Deep Learning[1]) and Lake, Salakhutdinov, and Tenenbaum who wrote the paper.

[1] https://www.technologyreview.com/s/544606/can-this-man-make-...