Paying participants: The impact of compensation on data quality

Kimberly R. More (Lead / Corresponding author), Kayla A. Burd, Curt More, L. Alison Phillips

Research output: Contribution to journalArticlepeer-review

Abstract

Poor-quality data has the potential to increase error variance, reduce statistical power and effect sizes, and produce Type I or Type II errors. Paying participants is one technique researchers may use in an attempt to obtain high-quality data. Accordingly, two secondary datasets were used to examine the relationship between participant payment and data quality. The first dataset revealed that data quality did not differ between paid and unpaid undergraduates. Similarly, the second dataset showed that data quality did not differ between unpaid community participants and MTurkers. A comparison across studies showed that undergraduate students engaged in lower levels of careless responding than the community samples but the unpaid community sample outperformed the MTurk sample and both undergraduate samples. Taken together, the current findings suggest that offering financial incentives to undergraduate or community samples does not improve data quality but may improve data collection rates and increase the diversity of participants.
Original languageEnglish
Pages (from-to)403-417
Number of pages15
JournalTesting, Psychometrics, Methodology in Applied Psychology
Volume29
Issue number4
DOIs
Publication statusPublished - Dec 2022

Keywords

  • Participant compensation
  • Data quality
  • Surveys
  • Research methods
  • Data collection

Fingerprint

Dive into the research topics of 'Paying participants: The impact of compensation on data quality'. Together they form a unique fingerprint.

Cite this