reviewACM Computing SurveysJan 12, 2022HYBRID OA

Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networks

Universidade Federal de São Carlos · Universidade Estadual Paulista (Unesp)

Indexed inarxivcrossref

Abstract

Several image processing tasks, such as image classification and object detection, have been significantly improved using Convolutional Neural Networks (CNN). Like ResNet and EfficientNet, many architectures have achieved outstanding results in at least one dataset by the time of their creation. A critical factor in training concerns the network’s regularization, which prevents the structure from overfitting. This work analyzes several regularization methods developed in the past few years, showing significant improvements for different CNN models. The works are classified into three main areas: the first one is called “data augmentation,” where all the techniques focus on performing changes in the input data.…

Citation impact

377
total citations
FWCI
33.79
Percentile
100%
References
100
Citations per year

Authors

2

Topics & keywords

Keywords
  • Overfitting
  • Computer science
  • Convolutional neural network
  • Regularization (linguistics)
  • Artificial intelligence
  • Machine learning
  • Pattern recognition (psychology)
  • Artificial neural network
No related works found for this paper.

Funding