Towards Reasoning in Large Language Models: A Survey

Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in natural language processing, and there is observation that these models may exhibit reasoning abilities when they are sufficiently large. However, it is not yet clear to what extent LLMs are capable of reasoning. This paper provides a comprehensive overview of the current state of knowledge on reasoning in LLMs, including techniques for improving and eliciting reasoning in these models, methods and benchmarks for evaluating reasoning abilities, findings and implications of…

• NS
  National Science Foundation

  Awards: IIS 16-33755, IIS 16-19302
• CF
  Center for Cognitive Computing Systems Research
• D
  DeepMind
• ZU
  Zhejiang University

  Award: 083650
• UO
  University of Illinois at Urbana-Champaign
• OO
  Office of the Vice Chancellor for Research, University of Illinois at Chicago