An overview of realist evaluation for simulation-based education

Alastair C. Graham (Lead / Corresponding author), Sean McAleer

Research output: Contribution to journalArticle

123 Downloads (Pure)

Abstract

This article describes the key features of realist (realistic) evaluation and illustrates their application using, as an example, a simulation-based course for final year medical students. The use of simulation-based education (SBE) is increasing and so too is the evidence supporting its value as a powerful technique which can lead to substantial educational benefits. Accompanying these changes is a call for research into its use to be more theory-driven and to investigate both 'Did it work?' and as importantly 'Why did it work (or not)?' An evaluation methodology that is capable of answering both questions is realist evaluation. Realist evaluation is an emerging methodology that is suited to evaluating complex interventions such as SBE. The realist philosophy positions itself between positivist and constructivist paradigms and seeks to answer the question 'What works for whom, in what circumstances and why?' In seeking to answer this question, realist evaluation sets out to identify three fundamental components of an intervention, namely context, mechanism and outcome. Educational programmes work (successful outcomes) when theory-driven interventions (mechanisms) are applied to groups under appropriate conditions (context). Realist research uses a mixed methods (qualitative and quantitative) approach to gathering data in order to test the proposed context-mechanism-outcome (CMO) configurations of the intervention under investigation. Realist evaluation offers a valuable methodology for researchers investigating interventions utilising simulation-based education. By investigating and understanding the context, mechanisms and outcomes of SBE interventions, realist evaluation can provide the deeper level of understanding being called for.

Original languageEnglish
Article number13
Pages (from-to)1-8
Number of pages8
JournalAdvances in Simulation
Volume3
DOIs
Publication statusPublished - 17 Jul 2018

Fingerprint

Education
Medical Students
Research
Research Personnel

Keywords

  • Simulation
  • Simulation-based education
  • Realistic evaluation
  • Realist evaluation
  • Realism
  • Medical students

Cite this

@article{443d061285df41ee85d2418c99375443,
title = "An overview of realist evaluation for simulation-based education",
abstract = "This article describes the key features of realist (realistic) evaluation and illustrates their application using, as an example, a simulation-based course for final year medical students. The use of simulation-based education (SBE) is increasing and so too is the evidence supporting its value as a powerful technique which can lead to substantial educational benefits. Accompanying these changes is a call for research into its use to be more theory-driven and to investigate both 'Did it work?' and as importantly 'Why did it work (or not)?' An evaluation methodology that is capable of answering both questions is realist evaluation. Realist evaluation is an emerging methodology that is suited to evaluating complex interventions such as SBE. The realist philosophy positions itself between positivist and constructivist paradigms and seeks to answer the question 'What works for whom, in what circumstances and why?' In seeking to answer this question, realist evaluation sets out to identify three fundamental components of an intervention, namely context, mechanism and outcome. Educational programmes work (successful outcomes) when theory-driven interventions (mechanisms) are applied to groups under appropriate conditions (context). Realist research uses a mixed methods (qualitative and quantitative) approach to gathering data in order to test the proposed context-mechanism-outcome (CMO) configurations of the intervention under investigation. Realist evaluation offers a valuable methodology for researchers investigating interventions utilising simulation-based education. By investigating and understanding the context, mechanisms and outcomes of SBE interventions, realist evaluation can provide the deeper level of understanding being called for.",
keywords = "Simulation, Simulation-based education, Realistic evaluation, Realist evaluation, Realism, Medical students",
author = "Graham, {Alastair C.} and Sean McAleer",
year = "2018",
month = "7",
day = "17",
doi = "10.1186/s41077-018-0073-6",
language = "English",
volume = "3",
pages = "1--8",
journal = "Advances in Simulation",
issn = "2059-0628",

}

An overview of realist evaluation for simulation-based education. / Graham, Alastair C. (Lead / Corresponding author); McAleer, Sean.

In: Advances in Simulation, Vol. 3, 13, 17.07.2018, p. 1-8.

Research output: Contribution to journalArticle

TY - JOUR

T1 - An overview of realist evaluation for simulation-based education

AU - Graham, Alastair C.

AU - McAleer, Sean

PY - 2018/7/17

Y1 - 2018/7/17

N2 - This article describes the key features of realist (realistic) evaluation and illustrates their application using, as an example, a simulation-based course for final year medical students. The use of simulation-based education (SBE) is increasing and so too is the evidence supporting its value as a powerful technique which can lead to substantial educational benefits. Accompanying these changes is a call for research into its use to be more theory-driven and to investigate both 'Did it work?' and as importantly 'Why did it work (or not)?' An evaluation methodology that is capable of answering both questions is realist evaluation. Realist evaluation is an emerging methodology that is suited to evaluating complex interventions such as SBE. The realist philosophy positions itself between positivist and constructivist paradigms and seeks to answer the question 'What works for whom, in what circumstances and why?' In seeking to answer this question, realist evaluation sets out to identify three fundamental components of an intervention, namely context, mechanism and outcome. Educational programmes work (successful outcomes) when theory-driven interventions (mechanisms) are applied to groups under appropriate conditions (context). Realist research uses a mixed methods (qualitative and quantitative) approach to gathering data in order to test the proposed context-mechanism-outcome (CMO) configurations of the intervention under investigation. Realist evaluation offers a valuable methodology for researchers investigating interventions utilising simulation-based education. By investigating and understanding the context, mechanisms and outcomes of SBE interventions, realist evaluation can provide the deeper level of understanding being called for.

AB - This article describes the key features of realist (realistic) evaluation and illustrates their application using, as an example, a simulation-based course for final year medical students. The use of simulation-based education (SBE) is increasing and so too is the evidence supporting its value as a powerful technique which can lead to substantial educational benefits. Accompanying these changes is a call for research into its use to be more theory-driven and to investigate both 'Did it work?' and as importantly 'Why did it work (or not)?' An evaluation methodology that is capable of answering both questions is realist evaluation. Realist evaluation is an emerging methodology that is suited to evaluating complex interventions such as SBE. The realist philosophy positions itself between positivist and constructivist paradigms and seeks to answer the question 'What works for whom, in what circumstances and why?' In seeking to answer this question, realist evaluation sets out to identify three fundamental components of an intervention, namely context, mechanism and outcome. Educational programmes work (successful outcomes) when theory-driven interventions (mechanisms) are applied to groups under appropriate conditions (context). Realist research uses a mixed methods (qualitative and quantitative) approach to gathering data in order to test the proposed context-mechanism-outcome (CMO) configurations of the intervention under investigation. Realist evaluation offers a valuable methodology for researchers investigating interventions utilising simulation-based education. By investigating and understanding the context, mechanisms and outcomes of SBE interventions, realist evaluation can provide the deeper level of understanding being called for.

KW - Simulation

KW - Simulation-based education

KW - Realistic evaluation

KW - Realist evaluation

KW - Realism

KW - Medical students

U2 - 10.1186/s41077-018-0073-6

DO - 10.1186/s41077-018-0073-6

M3 - Article

C2 - 30026966

VL - 3

SP - 1

EP - 8

JO - Advances in Simulation

JF - Advances in Simulation

SN - 2059-0628

M1 - 13

ER -