Registered Replication Report: Dijksterhuis & van Knippenberg (1998): ProfPrimeRRR

Michael O’Donnell; Leif D. Nelson; Evi Ackermann; Balazs Aczel; Athfah Akhtar; Silvio Aldrovandi; Nasseem Alshaif; Ronald Andringa; Mark Aveyard; Peter Babincak; Nursena Balatekin; Scott A. Baldwin; Gabriel Banik; Ernest Baskin; Raoul Bell; Olga Białobrzeska; Angie R. Birt; Walter R. Boot; Scott R. Braithwaite; Jessie C. Briggs; Axel Buchner; Desiree Budd; Kathryn Budzik; Lottie Bullens; Richard L. Bulley; Peter R. Cannon; Katarzyna Cantarero; Joseph Cesario; Stephanie Chambers; Christopher R. Chartier; Peggy Chekroun; Clara Chong; Axel Cleeremans; Sean P. Coary; Jacob Coulthard; Florien M. Cramwinckel; Thomas F. Denson; Marcos Díaz-Lago; Theresa E. DiDonato; Aaron Drummond; Julia Eberlen; Titus Ebersbach; John E. Edlund; Katherine M. Finnigan; Justin Fisher; Natalia Frankowska; Efraín García-Sánchez; Frank D. Golom; Andrew J. Graves; Kevin Greenberg; Mando Hanioti; Heather A. Hansen; Jenna A. Harder; Erin R. Harrell; Andree Hartanto; Michael Inzlicht; David J. Johnson; Andrew Karpinski; Victor N. Keller; Olivier Klein; Lina Koppel; Emiel Krahmer; Anthony Lantian; Michael J. Larson; Jean-Baptiste Légal; Richard E. Lucas; Dermot Lynott; Corey M. Magaldino; Karlijn Massar; Matthew T. McBee; Neil McLatchie; Nadhilla Melia; Michael C. Mensink; Laura Mieth; Samantha Moore-Berg; Geraldine Neeser; Ben R. Newell; Marret K. Noordewier; Asil Ali Özdogğru; Myrto Pantazi; Michał Parzuchowski; Kim Peters; Michael C. Philipp; Monique M. H. Pollmann; Panagiotis Rentzelas; Rosa Rodríguez-Bailón; Jan Philipp Röer; Ivan Ropovik; Nelson A. Roque; Carolina Rueda; Bastiaan T. Rutjens; Katey Sackett; Janos Salamon; Ángel Sánchez-Rodríguez; Blair Saunders; Juliette Schaafsma; Michael Schulte-Mecklenbeck; David R. Shanks; Martin F. Sherman; Kenneth M. Steele; Niklas K. Steffens; Jessie Sun; Kyle J. Susa; Barnabas Szaszi; Aba Szollosi; Ricardo M. Tamayo; Gustav Tinghög; Yuk-yue Tong; Carol Tweten; Miguel A. Vadillo; Deisy Valcarcel; Nicolas Van der Linden; Michiel van Elk; Frenk van Harreveld; Daniel Västfjäll; Simine Vazire; Philippe Verduyn; Matt N. Williams; Guillermo B. Willis; Sarah E. Wood; Chunliang Yang; Oulmann Zerhouni; Robert Zheng; Mark Zrubka

doi:10.1177/1745691618755704

Registered Replication Report: Dijksterhuis & van Knippenberg (1998): ProfPrimeRRR

Michael O’Donnell, Leif D. Nelson, Evi Ackermann, Balazs Aczel, Athfah Akhtar, Silvio Aldrovandi, Nasseem Alshaif, Ronald Andringa, Mark Aveyard, Peter Babincak, Nursena Balatekin, Scott A. Baldwin, Gabriel Banik, Ernest Baskin, Raoul Bell, Olga Białobrzeska, Angie R. Birt, Walter R. Boot, Scott R. Braithwaite, Jessie C. BriggsAxel Buchner, Desiree Budd, Kathryn Budzik, Lottie Bullens, Richard L. Bulley, Peter R. Cannon, Katarzyna Cantarero, Joseph Cesario, Stephanie Chambers, Christopher R. Chartier, Peggy Chekroun, Clara Chong, Axel Cleeremans, Sean P. Coary, Jacob Coulthard, Florien M. Cramwinckel, Thomas F. Denson, Marcos Díaz-Lago, Theresa E. DiDonato, Aaron Drummond, Julia Eberlen, Titus Ebersbach, John E. Edlund, Katherine M. Finnigan, Justin Fisher, Natalia Frankowska, Efraín García-Sánchez, Frank D. Golom, Andrew J. Graves, Kevin Greenberg, Mando Hanioti, Heather A. Hansen, Jenna A. Harder, Erin R. Harrell, Andree Hartanto, Michael Inzlicht, David J. Johnson, Andrew Karpinski, Victor N. Keller, Olivier Klein, Lina Koppel, Emiel Krahmer, Anthony Lantian, Michael J. Larson, Jean-Baptiste Légal, Richard E. Lucas, Dermot Lynott, Corey M. Magaldino, Karlijn Massar, Matthew T. McBee, Neil McLatchie, Nadhilla Melia, Michael C. Mensink, Laura Mieth, Samantha Moore-Berg, Geraldine Neeser, Ben R. Newell, Marret K. Noordewier, Asil Ali Özdogğru, Myrto Pantazi, Michał Parzuchowski, Kim Peters, Michael C. Philipp, Monique M. H. Pollmann, Panagiotis Rentzelas, Rosa Rodríguez-Bailón, Jan Philipp Röer, Ivan Ropovik, Nelson A. Roque, Carolina Rueda, Bastiaan T. Rutjens, Katey Sackett, Janos Salamon, Ángel Sánchez-Rodríguez, Blair Saunders, Juliette Schaafsma, Michael Schulte-Mecklenbeck, David R. Shanks, Martin F. Sherman, Kenneth M. Steele, Niklas K. Steffens, Jessie Sun, Kyle J. Susa, Barnabas Szaszi, Aba Szollosi, Ricardo M. Tamayo, Gustav Tinghög, Yuk-yue Tong, Carol Tweten, Miguel A. Vadillo, Deisy Valcarcel, Nicolas Van der Linden, Michiel van Elk, Frenk van Harreveld, Daniel Västfjäll, Simine Vazire, Philippe Verduyn, Matt N. Williams, Guillermo B. Willis, Sarah E. Wood, Chunliang Yang, Oulmann Zerhouni, Robert Zheng, Mark Zrubka

Psychology

Research output: Contribution to journal › Article › peer-review

56 Citations (Scopus)

453 Downloads (Pure)

Abstract

Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence (“professor”) subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence (“soccer hooligans”). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%–3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and −0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the “professor” category and those primed with the “hooligan” category (0.14%) and no moderation by gender.

Original language	English
Pages (from-to)	268-294
Number of pages	27
Journal	Perspectives on Psychological Science
Volume	13
Issue number	2
Early online date	21 Feb 2018
DOIs	https://doi.org/10.1177/1745691618755704
Publication status	Published - 1 Mar 2018

Keywords

intelligence
priming
replication

ASJC Scopus subject areas

General Psychology

Access to Document

10.1177/1745691618755704

Author Accepted ManuscriptAccepted author manuscript, 734 KB

https://doi.org/10.1177/1745691618755704

Cite this

O’Donnell, M., Nelson, L. D., Ackermann, E., Aczel, B., Akhtar, A., Aldrovandi, S., Alshaif, N., Andringa, R., Aveyard, M., Babincak, P., Balatekin, N., Baldwin, S. A., Banik, G., Baskin, E., Bell, R., Białobrzeska, O., Birt, A. R., Boot, W. R., Braithwaite, S. R., ... Zrubka, M. (2018). Registered Replication Report: Dijksterhuis & van Knippenberg (1998): ProfPrimeRRR. Perspectives on Psychological Science, 13(2), 268-294. https://doi.org/10.1177/1745691618755704

@article{e6bd55caa2b9490fa11771b51b56d242,

title = "Registered Replication Report: Dijksterhuis & van Knippenberg (1998): ProfPrimeRRR",

abstract = "Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence (“professor”) subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence (“soccer hooligans”). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%–3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and −0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the “professor” category and those primed with the “hooligan” category (0.14%) and no moderation by gender.",

keywords = "intelligence, priming, replication",

author = "Michael O{\textquoteright}Donnell and Nelson, {Leif D.} and Evi Ackermann and Balazs Aczel and Athfah Akhtar and Silvio Aldrovandi and Nasseem Alshaif and Ronald Andringa and Mark Aveyard and Peter Babincak and Nursena Balatekin and Baldwin, {Scott A.} and Gabriel Banik and Ernest Baskin and Raoul Bell and Olga Bia{\l}obrzeska and Birt, {Angie R.} and Boot, {Walter R.} and Braithwaite, {Scott R.} and Briggs, {Jessie C.} and Axel Buchner and Desiree Budd and Kathryn Budzik and Lottie Bullens and Bulley, {Richard L.} and Cannon, {Peter R.} and Katarzyna Cantarero and Joseph Cesario and Stephanie Chambers and Chartier, {Christopher R.} and Peggy Chekroun and Clara Chong and Axel Cleeremans and Coary, {Sean P.} and Jacob Coulthard and Cramwinckel, {Florien M.} and Denson, {Thomas F.} and Marcos D{\'i}az-Lago and DiDonato, {Theresa E.} and Aaron Drummond and Julia Eberlen and Titus Ebersbach and Edlund, {John E.} and Finnigan, {Katherine M.} and Justin Fisher and Natalia Frankowska and Efra{\'i}n Garc{\'i}a-S{\'a}nchez and Golom, {Frank D.} and Graves, {Andrew J.} and Kevin Greenberg and Mando Hanioti and Hansen, {Heather A.} and Harder, {Jenna A.} and Harrell, {Erin R.} and Andree Hartanto and Michael Inzlicht and Johnson, {David J.} and Andrew Karpinski and Keller, {Victor N.} and Olivier Klein and Lina Koppel and Emiel Krahmer and Anthony Lantian and Larson, {Michael J.} and Jean-Baptiste L{\'e}gal and Lucas, {Richard E.} and Dermot Lynott and Magaldino, {Corey M.} and Karlijn Massar and McBee, {Matthew T.} and Neil McLatchie and Nadhilla Melia and Mensink, {Michael C.} and Laura Mieth and Samantha Moore-Berg and Geraldine Neeser and Newell, {Ben R.} and Noordewier, {Marret K.} and {\"O}zdogğru, {Asil Ali} and Myrto Pantazi and Micha{\l} Parzuchowski and Kim Peters and Philipp, {Michael C.} and Pollmann, {Monique M. H.} and Panagiotis Rentzelas and Rosa Rodr{\'i}guez-Bail{\'o}n and R{\"o}er, {Jan Philipp} and Ivan Ropovik and Roque, {Nelson A.} and Carolina Rueda and Rutjens, {Bastiaan T.} and Katey Sackett and Janos Salamon and {\'A}ngel S{\'a}nchez-Rodr{\'i}guez and Blair Saunders and Juliette Schaafsma and Michael Schulte-Mecklenbeck and Shanks, {David R.} and Sherman, {Martin F.} and Steele, {Kenneth M.} and Steffens, {Niklas K.} and Jessie Sun and Susa, {Kyle J.} and Barnabas Szaszi and Aba Szollosi and Tamayo, {Ricardo M.} and Gustav Tingh{\"o}g and Yuk-yue Tong and Carol Tweten and Vadillo, {Miguel A.} and Deisy Valcarcel and Linden, {Nicolas Van der} and Elk, {Michiel van} and Harreveld, {Frenk van} and Daniel V{\"a}stfj{\"a}ll and Simine Vazire and Philippe Verduyn and Williams, {Matt N.} and Willis, {Guillermo B.} and Wood, {Sarah E.} and Chunliang Yang and Oulmann Zerhouni and Robert Zheng and Mark Zrubka",

note = "Thanks to the Association for Psychological Science (APS) and the Arnold Foundation who provided funding to participating laboratories to defray the costs of running the study. We thank Ap Dijksterhuis for providing materials and helping to ensure the accuracy of the protocol, Katherine Wood for coding the experiment and analysis scripts and for help in adapting the code for translated versions of the scripts, and Andy DeSoto at APS for gathering trivia items and conducting the MTurk norming studies for them.",

year = "2018",

month = mar,

day = "1",

doi = "10.1177/1745691618755704",

language = "English",

volume = "13",

pages = "268--294",

journal = "Perspectives on Psychological Science",

issn = "1745-6924",

publisher = "Association for Psychological Science",

number = "2",

}

O’Donnell, M, Nelson, LD, Ackermann, E, Aczel, B, Akhtar, A, Aldrovandi, S, Alshaif, N, Andringa, R, Aveyard, M, Babincak, P, Balatekin, N, Baldwin, SA, Banik, G, Baskin, E, Bell, R, Białobrzeska, O, Birt, AR, Boot, WR, Braithwaite, SR, Briggs, JC, Buchner, A, Budd, D, Budzik, K, Bullens, L, Bulley, RL, Cannon, PR, Cantarero, K, Cesario, J, Chambers, S, Chartier, CR, Chekroun, P, Chong, C, Cleeremans, A, Coary, SP, Coulthard, J, Cramwinckel, FM, Denson, TF, Díaz-Lago, M, DiDonato, TE, Drummond, A, Eberlen, J, Ebersbach, T, Edlund, JE, Finnigan, KM, Fisher, J, Frankowska, N, García-Sánchez, E, Golom, FD, Graves, AJ, Greenberg, K, Hanioti, M, Hansen, HA, Harder, JA, Harrell, ER, Hartanto, A, Inzlicht, M, Johnson, DJ, Karpinski, A, Keller, VN, Klein, O, Koppel, L, Krahmer, E, Lantian, A, Larson, MJ, Légal, J-B, Lucas, RE, Lynott, D, Magaldino, CM, Massar, K, McBee, MT, McLatchie, N, Melia, N, Mensink, MC, Mieth, L, Moore-Berg, S, Neeser, G, Newell, BR, Noordewier, MK, Özdogğru, AA, Pantazi, M, Parzuchowski, M, Peters, K, Philipp, MC, Pollmann, MMH, Rentzelas, P, Rodríguez-Bailón, R, Röer, JP, Ropovik, I, Roque, NA, Rueda, C, Rutjens, BT, Sackett, K, Salamon, J, Sánchez-Rodríguez, Á, Saunders, B, Schaafsma, J, Schulte-Mecklenbeck, M, Shanks, DR, Sherman, MF, Steele, KM, Steffens, NK, Sun, J, Susa, KJ, Szaszi, B, Szollosi, A, Tamayo, RM, Tinghög, G, Tong, Y, Tweten, C, Vadillo, MA, Valcarcel, D, Linden, NVD, Elk, MV, Harreveld, FV, Västfjäll, D, Vazire, S, Verduyn, P, Williams, MN, Willis, GB, Wood, SE, Yang, C, Zerhouni, O, Zheng, R & Zrubka, M 2018, 'Registered Replication Report: Dijksterhuis & van Knippenberg (1998): ProfPrimeRRR', Perspectives on Psychological Science, vol. 13, no. 2, pp. 268-294. https://doi.org/10.1177/1745691618755704

TY - JOUR

T1 - Registered Replication Report

T2 - Dijksterhuis & van Knippenberg (1998): ProfPrimeRRR

AU - O’Donnell, Michael

AU - Nelson, Leif D.

AU - Ackermann, Evi

AU - Aczel, Balazs

AU - Akhtar, Athfah

AU - Aldrovandi, Silvio

AU - Alshaif, Nasseem

AU - Andringa, Ronald

AU - Aveyard, Mark

AU - Babincak, Peter

AU - Balatekin, Nursena

AU - Baldwin, Scott A.

AU - Banik, Gabriel

AU - Baskin, Ernest

AU - Bell, Raoul

AU - Białobrzeska, Olga

AU - Birt, Angie R.

AU - Boot, Walter R.

AU - Braithwaite, Scott R.

AU - Briggs, Jessie C.

AU - Buchner, Axel

AU - Budd, Desiree

AU - Budzik, Kathryn

AU - Bullens, Lottie

AU - Bulley, Richard L.

AU - Cannon, Peter R.

AU - Cantarero, Katarzyna

AU - Cesario, Joseph

AU - Chambers, Stephanie

AU - Chartier, Christopher R.

AU - Chekroun, Peggy

AU - Chong, Clara

AU - Cleeremans, Axel

AU - Coary, Sean P.

AU - Coulthard, Jacob

AU - Cramwinckel, Florien M.

AU - Denson, Thomas F.

AU - Díaz-Lago, Marcos

AU - DiDonato, Theresa E.

AU - Drummond, Aaron

AU - Eberlen, Julia

AU - Ebersbach, Titus

AU - Edlund, John E.

AU - Finnigan, Katherine M.

AU - Fisher, Justin

AU - Frankowska, Natalia

AU - García-Sánchez, Efraín

AU - Golom, Frank D.

AU - Graves, Andrew J.

AU - Greenberg, Kevin

AU - Hanioti, Mando

AU - Hansen, Heather A.

AU - Harder, Jenna A.

AU - Harrell, Erin R.

AU - Hartanto, Andree

AU - Inzlicht, Michael

AU - Johnson, David J.

AU - Karpinski, Andrew

AU - Keller, Victor N.

AU - Klein, Olivier

AU - Koppel, Lina

AU - Krahmer, Emiel

AU - Lantian, Anthony

AU - Larson, Michael J.

AU - Légal, Jean-Baptiste

AU - Lucas, Richard E.

AU - Lynott, Dermot

AU - Magaldino, Corey M.

AU - Massar, Karlijn

AU - McBee, Matthew T.

AU - McLatchie, Neil

AU - Melia, Nadhilla

AU - Mensink, Michael C.

AU - Mieth, Laura

AU - Moore-Berg, Samantha

AU - Neeser, Geraldine

AU - Newell, Ben R.

AU - Noordewier, Marret K.

AU - Özdogğru, Asil Ali

AU - Pantazi, Myrto

AU - Parzuchowski, Michał

AU - Peters, Kim

AU - Philipp, Michael C.

AU - Pollmann, Monique M. H.

AU - Rentzelas, Panagiotis

AU - Rodríguez-Bailón, Rosa

AU - Röer, Jan Philipp

AU - Ropovik, Ivan

AU - Roque, Nelson A.

AU - Rueda, Carolina

AU - Rutjens, Bastiaan T.

AU - Sackett, Katey

AU - Salamon, Janos

AU - Sánchez-Rodríguez, Ángel

AU - Saunders, Blair

AU - Schaafsma, Juliette

AU - Schulte-Mecklenbeck, Michael

AU - Shanks, David R.

AU - Sherman, Martin F.

AU - Steele, Kenneth M.

AU - Steffens, Niklas K.

AU - Sun, Jessie

AU - Susa, Kyle J.

AU - Szaszi, Barnabas

AU - Szollosi, Aba

AU - Tamayo, Ricardo M.

AU - Tinghög, Gustav

AU - Tong, Yuk-yue

AU - Tweten, Carol

AU - Vadillo, Miguel A.

AU - Valcarcel, Deisy

AU - Linden, Nicolas Van der

AU - Elk, Michiel van

AU - Harreveld, Frenk van

AU - Västfjäll, Daniel

AU - Vazire, Simine

AU - Verduyn, Philippe

AU - Williams, Matt N.

AU - Willis, Guillermo B.

AU - Wood, Sarah E.

AU - Yang, Chunliang

AU - Zerhouni, Oulmann

AU - Zheng, Robert

AU - Zrubka, Mark

N1 - Thanks to the Association for Psychological Science (APS) and the Arnold Foundation who provided funding to participating laboratories to defray the costs of running the study. We thank Ap Dijksterhuis for providing materials and helping to ensure the accuracy of the protocol, Katherine Wood for coding the experiment and analysis scripts and for help in adapting the code for translated versions of the scripts, and Andy DeSoto at APS for gathering trivia items and conducting the MTurk norming studies for them.

PY - 2018/3/1

Y1 - 2018/3/1

N2 - Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence (“professor”) subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence (“soccer hooligans”). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%–3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and −0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the “professor” category and those primed with the “hooligan” category (0.14%) and no moderation by gender.

AB - Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence (“professor”) subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence (“soccer hooligans”). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%–3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and −0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the “professor” category and those primed with the “hooligan” category (0.14%) and no moderation by gender.

KW - intelligence

KW - priming

KW - replication

UR - http://www.scopus.com/inward/record.url?scp=85042363555&partnerID=8YFLogxK

U2 - 10.1177/1745691618755704

DO - 10.1177/1745691618755704

M3 - Article

C2 - 29463182

SN - 1745-6924

VL - 13

SP - 268

EP - 294

JO - Perspectives on Psychological Science

JF - Perspectives on Psychological Science

IS - 2

ER -

Registered Replication Report: Dijksterhuis & van Knippenberg (1998): ProfPrimeRRR

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this