Dendrites endow artificial neural networks with accurate, robust and parameter-efficient learning
Foundation for Research and Technology Hellas · Institute of Molecular Biology and Biotechnology
Abstract
Artificial neural networks (ANNs) are at the core of most Deep Learning (DL) algorithms that successfully tackle complex problems like image recognition, autonomous driving, and natural language processing. However, unlike biological brains who tackle similar problems in a very efficient manner, DL algorithms require a large number of trainable parameters, making them energy-intensive and prone to overfitting. Here, we show that a new ANN architecture that incorporates the structured connectivity and restricted sampling properties of biological dendrites counteracts these limitations. We find that dendritic ANNs are more robust to overfitting and match or outperform traditional ANNs on several image…
Citation impact
- FWCI
- 27.40
- Percentile
- 100%
- References
- 116
Authors
2Topics & keywords
- Overfitting
- Computer science
- Artificial intelligence
- Artificial neural network
- Machine learning
- Class (philosophy)
- Deep learning
- Quality Education
Funding
- ECEuropean CommissionAwards: H2020-FETOPEN-2018-2019-2020-01, 863245, GA-863245, H2020
- NINational Institutes of HealthAward: H2020
- H2Horizon 2020 Framework ProgrammeAwards: GA-863245, H2020-FETOPEN-2018-2019-2020-01, FETOPEN-2018-2019-2020-01, 863245
- NINational Institute of Mental HealthAward: 1R01MH124867-04