preprintarXiv (Cornell University)Jun 16, 2016GREEN OA

SQuAD: 100,000+ Questions for Machine Comprehension of Text

Indexed inarxivdatacite

Abstract

We present the Stanford Question Answering Dataset (SQuAD), a new reading comprehension dataset consisting of 100,000+ questions posed by crowdworkers on a set of Wikipedia articles, where the answer to each question is a segment of text from the corresponding reading passage. We analyze the dataset to understand the types of reasoning required to answer the questions, leaning heavily on dependency and constituency trees. We build a strong logistic regression model, which achieves an F1 score of 51.0%, a significant improvement over a simple baseline (20%). However, human performance (86.8%) is much higher, indicating that the dataset presents a good challenge problem for future research. The dataset is freely…

Citation impact

823
total citations
FWCI
Percentile
References
27
Citations per year

Authors

4

Topics & keywords

Keywords
  • Baseline (sea)
  • Comprehension
  • Dependency (UML)
  • Computer science
  • Reading comprehension
  • Set (abstract data type)
  • Reading (process)
  • Natural language processing
UN Sustainable Development Goals
  • Quality Education
No related works found for this paper.