Glancing at the paper, I see the biggest dataset they used was MNIST. So it's hard to quantify how much error they preserve for larger, more useful networks in more complicated tasks.