Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them

McGill University · Leiden University

Indexed incrossrefdoaj

Abstract

In this article, we define questionable measurement practices (QMPs) as decisions researchers make that raise doubts about the validity of the measures, and ultimately the validity of study conclusions. Doubts arise for a host of reasons, including a lack of transparency, ignorance, negligence, or misrepresentation of the evidence. We describe the scope of the problem and focus on how transparency is a part of the solution. A lack of measurement transparency makes it impossible to evaluate potential threats to internal, external, statistical-conclusion, and construct validity. We demonstrate that psychology is plagued by a measurement schmeasurement attitude: QMPs are common, hide a stunning source of…

Citation impact

801
total citations
FWCI
72.26
Percentile
100%
References
48
Citations per year

Authors

2

Topics & keywords

Keywords
  • Transparency (behavior)
  • Misrepresentation
  • Scope (computer science)
  • Set (abstract data type)
  • External validity
  • Ignorance
  • Construct (python library)
  • Replication (statistics)
UN Sustainable Development Goals
  • Peace, Justice and strong institutions
No related works found for this paper.