articlearXiv (Cornell University)May 5, 2017GREEN OA

Supervised Learning of Universal Sentence Representations from Natural\n Language Inference Data

Meta (Israel)

Indexed inarxiv

Abstract

Many modern NLP systems rely on word embeddings, previously trained in an\nunsupervised manner on large corpora, as base features. Efforts to obtain\nembeddings for larger chunks of text, such as sentences, have however not been\nso successful. Several attempts at learning unsupervised representations of\nsentences have not reached satisfactory enough performance to be widely\nadopted. In this paper, we show how universal sentence representations trained\nusing the supervised data of the Stanford Natural Language Inference datasets\ncan consistently outperform unsupervised methods like SkipThought vectors on a\nwide range of transfer tasks. Much like how computer vision uses ImageNet to\nobtain features, which…

Citation impact

2,062
total citations
FWCI
Percentile
References
48
Citations per year

Authors

5

Topics & keywords

Keywords
  • Computer science
  • Artificial intelligence
  • Natural language processing
  • Inference
  • Sentence
  • Unsupervised learning
  • Transfer of learning
  • Natural language
UN Sustainable Development Goals
  • Quality Education
No related works found for this paper.