KERMIT: Performance indicators in electronic patient reported outcome measures: a modified Delphi

TY - JOUR

T1 - KERMIT

T2 - Performance indicators in electronic patient reported outcome measures: a modified Delphi

AU - Hatton, Nathaniel Luke

AU - Baxter, Mark

AU - Lewis, Sally

AU - Hall, Peter S.

AU - Spencer, Katie

N1 - Publisher Copyright: © The Author(s) 2025.

PY - 2025/7/2

Y1 - 2025/7/2

N2 - Introduction: The use of electronic patient reported outcome measures (ePROMs) is increasing in routine cancer care, with benefit demonstrated in improving patient survival, satisfaction and response time. ePROMs represent a complex intervention, with successful implementation reliant upon a range of questionnaires, platform, patient and clinician characteristics alongside the wider organisational readiness and environment. Key performance indicators (KPIs) assess the performance of a system. A KPI framework would offer value in assessing ePROM implementation projects, however the outcomes and indicators of importance are not clear. Method: A modified Delphi methodology was used to define a framework of KPIs for assessing the deployment of ePROMs in routine cancer care. Potential KPIs were identified through literature searches, de-duplicated and allocated to a matrix of domains. Delphi participants were identified through a literature review and study team networks. KPIs were presented to participants for prioritisation using an online platform. A final set of KPIs was identified through two rounds of consensus with participants rating each KPI for relevance. Results: The literature search generated a list of 196 potential KPIs of which 48 were considered by 15 experts in the Delphi process. Consensus was reached to include 12 KPIs in the first round and a further 2 KPIs in the second round. Participant’s open text responses were analysed, suggesting a number of areas of debate regarding which KPIs are most pertinent. Discussion: This work provides a framework of 14 KPIs, covering those of relevance to patients, clinicians and health services and recognising the acceptability, feasibility and impact of ePROMs. This framework offers a means to appraise the implementation of ePROMs, supporting teams as they implement ePROMs in routine cancer care and other healthcare settings.

AB - Introduction: The use of electronic patient reported outcome measures (ePROMs) is increasing in routine cancer care, with benefit demonstrated in improving patient survival, satisfaction and response time. ePROMs represent a complex intervention, with successful implementation reliant upon a range of questionnaires, platform, patient and clinician characteristics alongside the wider organisational readiness and environment. Key performance indicators (KPIs) assess the performance of a system. A KPI framework would offer value in assessing ePROM implementation projects, however the outcomes and indicators of importance are not clear. Method: A modified Delphi methodology was used to define a framework of KPIs for assessing the deployment of ePROMs in routine cancer care. Potential KPIs were identified through literature searches, de-duplicated and allocated to a matrix of domains. Delphi participants were identified through a literature review and study team networks. KPIs were presented to participants for prioritisation using an online platform. A final set of KPIs was identified through two rounds of consensus with participants rating each KPI for relevance. Results: The literature search generated a list of 196 potential KPIs of which 48 were considered by 15 experts in the Delphi process. Consensus was reached to include 12 KPIs in the first round and a further 2 KPIs in the second round. Participant’s open text responses were analysed, suggesting a number of areas of debate regarding which KPIs are most pertinent. Discussion: This work provides a framework of 14 KPIs, covering those of relevance to patients, clinicians and health services and recognising the acceptability, feasibility and impact of ePROMs. This framework offers a means to appraise the implementation of ePROMs, supporting teams as they implement ePROMs in routine cancer care and other healthcare settings.

KW - Delphi study

KW - Electronic

KW - KPIs

KW - Key performance indicators

KW - PROMS

KW - ePROMS

UR - https://www.scopus.com/pages/publications/105010112755

U2 - 10.1186/s41687-025-00898-x

DO - 10.1186/s41687-025-00898-x

M3 - Article

C2 - 40603694

VL - 9

JO - Journal of Patient-Reported Outcomes

JF - Journal of Patient-Reported Outcomes

M1 - 81

ER -