Flexible multitask computation in recurrent networks utilizes shared dynamical motifs
Stanford University · Howard Hughes Medical Institute · +1 more institution
Abstract
Flexible computation is a hallmark of intelligent behavior. However, little is known about how neural networks contextually reconfigure for different computations. In the present work, we identified an algorithmic neural substrate for modular computation through the study of multitasking artificial recurrent neural networks. Dynamical systems analyses revealed learned computational strategies mirroring the modular subtask structure of the training task set. Dynamical motifs, which are recurring patterns of neural activity that implement specific computations through dynamics, such as attractors, decision boundaries and rotations, were reused across tasks. For example, tasks requiring memory of a continuous…
Citation impact
- FWCI
- 37.88
- Percentile
- 100%
- References
- 60
Authors
3Topics & keywords
- Computer science
- Modular design
- Computation
- Attractor
- Dynamical systems theory
- Reservoir computing
- Artificial intelligence
- Human multitasking