I believe this problem is common to many types of machine learning classifiers (not even just neural nets). See the discussion here https://news.ycombinator.com/item?id=8721650