Embodied large language models enable robots to complete complex tasks in unpredictable environments
Princeton University · Massachusetts Institute of Technology · +2 more institutions
Abstract
Completing complex tasks in unpredictable settings challenges robotic systems, requiring a step change in machine intelligence. Sensorimotor abilities are considered integral to human intelligence. Thus, biologically inspired machine intelligence might usefully combine artificial intelligence with robotic sensorimotor capabilities. Here we report an embodied large-language-model-enabled robot (ELLMER) framework, utilizing GPT-4 and a retrieval-augmented generation infrastructure, to enable robots to complete long-horizon tasks in unpredictable settings. The method extracts contextually relevant examples from a knowledge base, producing action plans that incorporate force and visual feedback and enabling…
Citation impact
- FWCI
- 61.18
- Percentile
- 100%
- References
- 58
Authors
5Topics & keywords
- Embodied cognition
- Robot
- Computer science
- Human–computer interaction
- Artificial intelligence