preprintarXiv (Cornell University)Aug 22, 2017GREEN OA

BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain

Indexed inarxivdatacite

Abstract

Deep learning-based techniques have achieved state-of-the-art performance on a wide variety of recognition and classification tasks. However, these networks are typically computationally expensive to train, requiring weeks of computation on many GPUs; as a result, many users outsource the training procedure to the cloud or rely on pre-trained models that are then fine-tuned for a specific task. In this paper we show that outsourced training introduces new security risks: an adversary can create a maliciously trained network (a backdoored neural network, or a \emph{BadNet}) that has state-of-the-art performance on the user's training and validation samples, but behaves badly on specific attacker-chosen inputs.…

Citation impact

1,003
total citations
FWCI
Percentile
References
25
Citations per year

Authors

3

Topics & keywords

Keywords
  • Backdoor
  • Computer science
  • Debugging
  • Classifier (UML)
  • Traffic sign recognition
  • Adversary
  • Artificial intelligence
  • Artificial neural network
UN Sustainable Development Goals
  • Peace, Justice and strong institutions
No related works found for this paper.