Re:Planting Undetectable Backdoors in Machine Learning Models
by gmfawcett on Tuesday April 19, 2022 @05:44PM
(#31089689)
Wouldn't they deserve far more scrutiny? I know how to review your source code, but how do I review your ML model?
[ Parent
| on HN ]
Re:Planting Undetectable Backdoors in Machine Learning Models
by galcerte on Tuesday April 19, 2022 @07:37PM
(#31090810)
By reviewing the source code of the model, reviewing the training data, and reviewing weight initialization, but the latter should be specified in the source code. Also making it abundantly clear that the libraries used to make the model were not tampered with, maybe hashing their files or doing some reproducible builds wizardry...
Edit: Now that I think about it, can't data poisoning happen when predicting, rather than just happening in the training phase? In that case, it's going to be complicated to work around that.