Orthogonal representations for robust context-dependent task performance in brains and neural networks
University of Oxford · St. John's College · +4 more institutions
Abstract
How do neural populations code for multiple, potentially conflicting tasks? Here we used computational simulations involving neural networks to define "lazy" and "rich" coding solutions to this context-dependent decision-making problem, which trade off learning speed for robustness. During lazy learning the input dimensionality is expanded by random projections to the network hidden layer, whereas in rich learning hidden units acquire structured representations that privilege relevant over irrelevant features. For context-dependent decision-making, one rich solution is to project task representations onto low-dimensional and orthogonal manifolds. Using behavioral testing and neuroimaging in humans and analysis…
Citation impact
- FWCI
- 27.92
- Percentile
- 100%
- References
- 72
Authors
5- TFTimo FleschCorresponding
University of Oxford
- KJKeno Juechems
University of Oxford, St. John's College
- TDTsvetomira Dumbalska
University of Oxford
- ASAndrew SaxeCorresponding
Canadian Institute for Advanced Research, Ofcom, Sainsbury Laboratory, University College London
- CSChristopher SummerfieldCorresponding
University of Oxford
Topics & keywords
- Artificial neural network
- Computer science
- Curse of dimensionality
- Artificial intelligence
- Neural coding
- Coding (social sciences)
- Context (archaeology)
- Computational neuroscience
- Peace, Justice and strong institutions