Multi-method evaluation of a national clinical fellowship programme to build leadership capacity for quality improvement

TY - JOUR

T1 - Multi-method evaluation of a national clinical fellowship programme to build leadership capacity for quality improvement

AU - Toma, Madalina

AU - Blamey, Avril

AU - Mahal, Dawn

AU - Gray, Nicola M.

AU - Allison, Laura

AU - Thakore, Shobhan

AU - Bowie, Paul

N1 - Funding Information: Funding SISCC is funded by the Scottish Funding Council, Chief Scientist’s Office, NHS Education for Scotland and The Health Foundation with in-kind contributions from participating partner universities and health boards. The grant reference number is 242 343 290 was received from SFC on behalf of all funders. Additional funding and resource was provided by SKIRC, NHS Education for Scotland.

PY - 2020/10/14

Y1 - 2020/10/14

N2 - Background: This paper reports the results of the evaluation of the Scottish Quality and Safety Fellowship (SQSF)-a 10-month, lead-level international educational programme established in 2008 with the overarching aim of developing clinicians with advanced quality improvement knowledge, technical ability and essential leadership skills. The evaluation explores four levels of educational and practice outcomes associated with (1) the reaction of fellows to SQSF participation, (2) learning gained, (3) subsequent behaviour changes and (4) the overall impact on national and international level capability and capacity building.Methods: A theory-informed multi-method design was applied using (1) a search and review of the SQSF organisational database to tabulate personal, professional and demographic characteristics; (2) semi-structured telephone interviews with 16 participants using purposive and self-selected sampling; and (3) a cross-sectional online evaluation survey across all 10 cohorts involving 222 fellows .Results: SQSF was positively perceived as a high-quality learning experience containing a well-balanced mix of theory and practice, with a majority of respondents reporting career changing benefits. Most participants reported improved social, behavioural and emotional skills, knowledge and attitudes and, with sustained support of their host organisations, were able to apply and share learning in their workplace. The impact of the SQSF on a wider national and international level capability and capacity was both mediated and moderated by a wide range of interrelated contextual factors.Conclusions: This multi-method evaluation demonstrates that SQSF has achieved significant positive outcomes for the great majority of participants. Some tentative recommendations are provided with the aim of further enhancing fellowship content, delivery, transfer and future evaluations of wider impacts at regional, national and international health system levels.

AB - Background: This paper reports the results of the evaluation of the Scottish Quality and Safety Fellowship (SQSF)-a 10-month, lead-level international educational programme established in 2008 with the overarching aim of developing clinicians with advanced quality improvement knowledge, technical ability and essential leadership skills. The evaluation explores four levels of educational and practice outcomes associated with (1) the reaction of fellows to SQSF participation, (2) learning gained, (3) subsequent behaviour changes and (4) the overall impact on national and international level capability and capacity building.Methods: A theory-informed multi-method design was applied using (1) a search and review of the SQSF organisational database to tabulate personal, professional and demographic characteristics; (2) semi-structured telephone interviews with 16 participants using purposive and self-selected sampling; and (3) a cross-sectional online evaluation survey across all 10 cohorts involving 222 fellows .Results: SQSF was positively perceived as a high-quality learning experience containing a well-balanced mix of theory and practice, with a majority of respondents reporting career changing benefits. Most participants reported improved social, behavioural and emotional skills, knowledge and attitudes and, with sustained support of their host organisations, were able to apply and share learning in their workplace. The impact of the SQSF on a wider national and international level capability and capacity was both mediated and moderated by a wide range of interrelated contextual factors.Conclusions: This multi-method evaluation demonstrates that SQSF has achieved significant positive outcomes for the great majority of participants. Some tentative recommendations are provided with the aim of further enhancing fellowship content, delivery, transfer and future evaluations of wider impacts at regional, national and international health system levels.

KW - continuing education

KW - continuing professional development

KW - education

KW - evaluation methodology

KW - healthcare quality improvement

KW - leadership

UR - https://www.scopus.com/pages/publications/85093479481

U2 - 10.1136/bmjoq-2020-000978

DO - 10.1136/bmjoq-2020-000978

M3 - Article

C2 - 33055177

SN - 2399-6641

VL - 9

JO - BMJ Open Quality

JF - BMJ Open Quality

IS - 4

M1 - e000978

ER -