News for hackers. Stuff that matters.
Re:BadNets: Identifying vulnerabilities in the machine learn... by joe_the_user on Wednesday October 18, 2017 @09:52PM (#15504881)
The thing with neural nets is that once one gets over being impressed by their ability to do an impressive variety of things that previously weren't doable, and consider them as simply applications that have to stand with other applications, they look like ... the worst applications ever.

They're ... undocumented and have specified behavior (leading to serious, not-hypothetical problems like racial bias). Their maintenance is unspecified or nonexistent. They inherently have security holes in a multitude of fashions. Their performance isn't guaranteed and measured only against their own benchmarks, etc...

This kind of thing is much more of a problem when they have to be a system used by a large institution as just part of its operations (a loan evaluation program or a recidivism indicator) rather than a standard alone application (a program to play the game of go). But in the former capacity, a lot more work needs to be done.

There are no comments on this comment yet.