articleJournal of Behavioral Decision MakingApr 2, 2012Closed access

Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk Samples

JKJoseph K. GoodmanCCCynthia CryderACAmar Cheema

Washington University in St. Louis · University of Virginia

Indexed incrossref

Abstract

ABSTRACT Mechanical Turk (MTurk), an online labor system run by Amazon.com, provides quick, easy, and inexpensive access to online research participants. As use of MTurk has grown, so have questions from behavioral researchers about its participants, reliability, and low compensation. In this article, we review recent research about MTurk and compare MTurk participants with community and student samples on a set of personality dimensions and classic decision‐making biases. Across two studies, we find many similarities between MTurk participants and traditional samples, but we also find important differences. For instance, MTurk participants are less likely to pay attention to experimental materials, reducing…

Citation impact

2,287
total citations
FWCI
168.48
Percentile
100%
References
48
Citations per year

Authors

3

Topics & keywords

Topics
Keywords
  • Psychology
  • Extraversion and introversion
  • Set (abstract data type)
  • Sample (material)
  • Social psychology
  • Data collection
  • Personality
  • Incentive
No related works found for this paper.

Funding