Improving the quality of written feedback using written feedback

MH Bartlett, J Crossley, Robert McKinley

    Research output: Contribution to journalArticle

    66 Downloads (Pure)

    Abstract

    Background
    Educational feedback is amongst the most powerful of all learning interventions.

    Research questions
    1. Can we measure the quality of written educational feedback with acceptable metrics?
    2. Based on such a measure, does a quality improvement (QI) intervention improve the quality of feedback?

    Study design
    We developed a QI instrument to measure the quality of written feedback and applied it to written feedback provided to medical students following workplace assessments. We evaluated the measurement characteristics of the QI score using generalisability theory. In an uncontrolled intervention, QI profiles were fed back to GP tutors and pre and post intervention scores compared.

    Study results
    A single assessor scoring 6 feedback summaries can discriminate between practices with a reliability of 0.82. The quality of feedback rose for two years after the introduction of the QI instrument and stabilised in the third year. The estimated annual cost to provide this feedback is £12 per practice.

    Interpretation and recommendations
    It is relatively straightforward and inexpensive to measure the quality of written feedback with good reliability. The QI process appears to improve the quality of written feedback. We recommend routine use of a QI process to improve the quality of educational feedback.
    Original languageEnglish
    JournalEducation for Primary Care
    Publication statusPublished - 1 Aug 2016

    Fingerprint

    Quality Improvement
    Medical Students
    Workplace
    Learning
    Costs and Cost Analysis
    Research

    Keywords

    • feedback
    • undergraduate medical education
    • educational assessment
    • quality improvement

    Cite this

    @article{f4ec3b65ae4845ba8ec68397998f2a89,
    title = "Improving the quality of written feedback using written feedback",
    abstract = "Background Educational feedback is amongst the most powerful of all learning interventions. Research questions 1. Can we measure the quality of written educational feedback with acceptable metrics? 2. Based on such a measure, does a quality improvement (QI) intervention improve the quality of feedback? Study design We developed a QI instrument to measure the quality of written feedback and applied it to written feedback provided to medical students following workplace assessments. We evaluated the measurement characteristics of the QI score using generalisability theory. In an uncontrolled intervention, QI profiles were fed back to GP tutors and pre and post intervention scores compared. Study results A single assessor scoring 6 feedback summaries can discriminate between practices with a reliability of 0.82. The quality of feedback rose for two years after the introduction of the QI instrument and stabilised in the third year. The estimated annual cost to provide this feedback is £12 per practice. Interpretation and recommendations It is relatively straightforward and inexpensive to measure the quality of written feedback with good reliability. The QI process appears to improve the quality of written feedback. We recommend routine use of a QI process to improve the quality of educational feedback.",
    keywords = "feedback, undergraduate medical education, educational assessment, quality improvement",
    author = "MH Bartlett and J Crossley and Robert McKinley",
    year = "2016",
    month = "8",
    day = "1",
    language = "English",
    journal = "Education for Primary Care",
    issn = "1473-9879",
    publisher = "Taylor & Francis",

    }

    Improving the quality of written feedback using written feedback. / Bartlett, MH; Crossley, J; McKinley, Robert .

    In: Education for Primary Care, 01.08.2016.

    Research output: Contribution to journalArticle

    TY - JOUR

    T1 - Improving the quality of written feedback using written feedback

    AU - Bartlett, MH

    AU - Crossley, J

    AU - McKinley, Robert

    PY - 2016/8/1

    Y1 - 2016/8/1

    N2 - Background Educational feedback is amongst the most powerful of all learning interventions. Research questions 1. Can we measure the quality of written educational feedback with acceptable metrics? 2. Based on such a measure, does a quality improvement (QI) intervention improve the quality of feedback? Study design We developed a QI instrument to measure the quality of written feedback and applied it to written feedback provided to medical students following workplace assessments. We evaluated the measurement characteristics of the QI score using generalisability theory. In an uncontrolled intervention, QI profiles were fed back to GP tutors and pre and post intervention scores compared. Study results A single assessor scoring 6 feedback summaries can discriminate between practices with a reliability of 0.82. The quality of feedback rose for two years after the introduction of the QI instrument and stabilised in the third year. The estimated annual cost to provide this feedback is £12 per practice. Interpretation and recommendations It is relatively straightforward and inexpensive to measure the quality of written feedback with good reliability. The QI process appears to improve the quality of written feedback. We recommend routine use of a QI process to improve the quality of educational feedback.

    AB - Background Educational feedback is amongst the most powerful of all learning interventions. Research questions 1. Can we measure the quality of written educational feedback with acceptable metrics? 2. Based on such a measure, does a quality improvement (QI) intervention improve the quality of feedback? Study design We developed a QI instrument to measure the quality of written feedback and applied it to written feedback provided to medical students following workplace assessments. We evaluated the measurement characteristics of the QI score using generalisability theory. In an uncontrolled intervention, QI profiles were fed back to GP tutors and pre and post intervention scores compared. Study results A single assessor scoring 6 feedback summaries can discriminate between practices with a reliability of 0.82. The quality of feedback rose for two years after the introduction of the QI instrument and stabilised in the third year. The estimated annual cost to provide this feedback is £12 per practice. Interpretation and recommendations It is relatively straightforward and inexpensive to measure the quality of written feedback with good reliability. The QI process appears to improve the quality of written feedback. We recommend routine use of a QI process to improve the quality of educational feedback.

    KW - feedback

    KW - undergraduate medical education

    KW - educational assessment

    KW - quality improvement

    M3 - Article

    JO - Education for Primary Care

    JF - Education for Primary Care

    SN - 1473-9879

    ER -