A linear model should always be compared to these DNNs.

There was a paper last year or so that compared correctly tuned linear models to various deep belief net papers and found that the performance "gains" suddenly evaporated or were not nearly as great as originally published.

If I can track down that paper, I'll post it.