Re:Can science solve an 80-year-old Indian mystery?
by nerdponx on Tuesday October 04, 2016 @01:46PM
(#12637547)
I don't think there's anything available for CNNs other than resampling techniques like nested cross-validation.
I'm also a fan of sensitivity analysis, where you jitter one of the inputs, or one of the model parameters, and see how robust the output is to local noise.
ISV I'm not explicitly familiar with. But there's no reason you couldn't use one of the general purpose techniques from above.
That said, resampling is very computationally intensive, so I can understand why it's not that popular in conjunction with similarly intensive iterative fitting algorithms like backpropagation and MCMC. I didn't mean my post to be a criticism of the research as much as I wanted to just put a warning out there about an issue that researchers without deep statistical backgrounds tend to overlook.
I'm also a fan of sensitivity analysis, where you jitter one of the inputs, or one of the model parameters, and see how robust the output is to local noise.
ISV I'm not explicitly familiar with. But there's no reason you couldn't use one of the general purpose techniques from above.
That said, resampling is very computationally intensive, so I can understand why it's not that popular in conjunction with similarly intensive iterative fitting algorithms like backpropagation and MCMC. I didn't mean my post to be a criticism of the research as much as I wanted to just put a warning out there about an issue that researchers without deep statistical backgrounds tend to overlook.