Constructing and evaluating a validity argument for the final-year ward simulation exercise

Hettie Till (Lead / Corresponding author), Jean Ker, Carol Myford, Kevin Stirling, Gary Mires

    Research output: Contribution to journalArticlepeer-review

    1 Citation (Scopus)

    Abstract

    The authors report final-year ward simulation data from the University of Dundee Medical School. Faculty who designed this assessment intend for the final score to represent an individual senior medical student’s level of clinical performance. The results are included in each student’s portfolio as one source of evidence of the student’s capability as a practitioner, professional, and scholar. Our purpose in conducting this study was to illustrate how assessment designers who are creating assessments to evaluate clinical performance might develop propositions and then collect and examine various sources of evidence to construct and evaluate a validity argument. The data were from all 154 medical students who were in their final year of study at the University of Dundee Medical School in the 2010–2011 academic year. To the best of our knowledge, this is the first report on an analysis of senior medical students’ clinical performance while they were taking responsibility for the management of a simulated ward. Using multi-facet Rasch measurement and a generalizability theory approach, we examined various sources of validity evidence that the medical school faculty have gathered for a set of six propositions needed to support their use of scores as measures of students’ clinical ability. Based on our analysis of the evidence, we would conclude that, by and large, the propositions appear to be sound, and the evidence seems to support their proposed score interpretation. Given the body of evidence collected thus far, their intended interpretation seems defensible.

    Original languageEnglish
    Pages (from-to)1263-1289
    Number of pages27
    JournalAdvances in Health Sciences Education
    Volume20
    Issue number5
    Early online date26 Mar 2015
    DOIs
    Publication statusPublished - Dec 2015

    Keywords

    • Clinical ability
    • Clinical performance
    • Evaluating medical students’ fitness to practice
    • Generalizability theory
    • Multi-facet Rasch measurement
    • Score interpretation
    • Simulated ward
    • Simulation in assessment of clinical performance
    • Validity argument
    • Validity evidence
    • Validity propositions

    Fingerprint Dive into the research topics of 'Constructing and evaluating a validity argument for the final-year ward simulation exercise'. Together they form a unique fingerprint.

    Cite this